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FOREWpRD 



Problem-Solving Process: A Planner's Handbook for Program Improvement presents detailed 
information on the fogr major phases in the program improvement process: needs assessment, 
search and selection, implementation, and evaluation. Its prfinary purpose is to provide 
vocational educators with self-paced instruction in the framework of a problem-solving approach 
to program improvement. It is intended to provide both a general awareness and practical 
applications of the overall process. 

Following a nationwide expression^ a need and interest in prograr^ improvement activities^ 
this handbook was developed specifically for program planners to use in implementing 
innovative vocational education programs. 

The profession is indebted to Dr. Carol P. Kowle, Dr. Jay Smink, and Dr. Peg Stank for their 
scholarship in preparing this handbook. Dr. Stephen Preston of the Georgia State Department of 
Education, Carolyn Trohoski of Research and Information Services for Education, and Carol 
Spenper and David Greer of the National Center for Research in Vocationaf Education also 
contributed to the development of the paper through lh§ir critical review of the manuscript. 
Additional staff .who contributed to the project were Shelley Grieve, Raymond E. Harlan, Dr. 
Judith Samuelson, and'Dr. Robert Bhaerjrian. Editorial assistance was provided ycder the 
direction of Janet Kiplinger of the National Center's Field Services staff. 



y Robert E. Taylor 

Executive Director 
The National Center for Research 
in Vocational Education 
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EXECUTIVE SUMMARY 



The purpose of Jhis handbook is to provide program planners in vocational education with 
self-paced instruction inttie framework of a^problem-solving approach to program improvement. 
The process can be applied to vocational school administration and management, student 
services, staff development, and instructional program areas. It is intended to provide the user 
with- a general awareness as welLas some practical applications of the program improvement 
process.. * 

The program improvement prqcess has four major phases: needs assessment, search and 
selection, implementation, and ^evaluation. A section of the paper is devoted .to each of these four 
broad areas. In addition, 1 the fallowing twelve specific milestones are identified: (1) the priorities 
and goals of the school district' are identified.and/or developed, (2) the school district commits 
jtself to participate in the process, (3) a target area of need is identified, (4) specific needs are 
identified in the target area, (5j[a detailed needs summary is prepared for the target problem 
area, (6) alternative products and practices are identified, (7) products and practices are selected 
for installation, (8) the implementation plan for the products and practices selected is produced 
and approved, (9) the evaluation design is completed in order to assess the effectiveness of the 
products and practices, selected, (10) products and practices are installed, (11) products and 
practices are evaluated, and (12) further program management decisions are made/' 

?■ 

Concrete learning experiences are ver^ visible in the handbook. These experiences provide, 
the user with a planned seqfU^nce of teaming activities designed to-lead to the achievement of 
the overall objective, namel^Jp apply the program improvement process in an actual,school 
'setting. Certain components often included in handbooks of this type are background 
information concerning sgedfi| competencies and opportunities to practice or apply the . 
competencies. Both of tfiesel^ments are included. 

The format of each* swtid^ffol lows a similar pattern and includes the following features: 
initial background information;|the profile of a hypothetical area vocational school and casei 
study materials; andlhe learning experiences that include the v m(lestones (in a more detailed • 
form of ct^cklists)<the detailecWearning activities, and supplementary resources. 




i SECTION I 
THE PROBLEM-SOLVING PROCESS: A BRIEF OVERVIEW 

* • * * 

« General Purposes of the Handbook 

A major goal of vocationaheducation is to provide high-quality programs that lead to the 
successful placement of students in training-related employment. Hence, federal, state, and local 
administration^ of vocational education has focused on improving both the insJruction&T quality „ 
ar\d the organizational structure that supports these programs. 

The purpose of the handbook, therefore, is to provide program planners with self-paced . 
• instruction in a problem-solving approach to pVogranri improvement. The process can be applied 
"to area vocational dshpol administration and Management student services, and staff * 
development, as welrfes to instructional programs. In essence, the handbook is intended to • 
provide the user with a general awareness, as well as some practical applications, of the prograjp 
improvement process. The intent is that the program planner, working with the suggestions T 
provided here, will be able to "work through" the entire procedure. While each of the major areas 
can be— and has been— treated in greater depth elsewhere, the purpose of this handbook is to 
present a panoramic view of the process. The expectation is*that the user will explore the 
suggested resources* for additional materials when in-depth kr&wledg6 is desired. * * 

' While the handbook can be used alone, it is more desirable. to use it in a workshop setting 
with an experienced leader to provide additional examples. ♦ • ^ 

* ' ' '. Specific Behavioral Objectives 

^ * i 

The specific behavioral objectives relating to use of the handbook .are as follows: 
• '"Terminal* Objective 



After completing these readings and activities, the program planner will have the 
knowledge and skills to apply the problem-solving process in an actual school setting. 

* < * % 

Five "Enabling" Objectives 

VJ . After completing this brief overview, the program planner will have a general 
-knowledge of the sequence of activities in the problem-solving process. 

2. After completing the needs assessment section, the program planner will be able to 

* identify the educational needs of the area vocational school described in the case* 

* study and complete a general needs statement and a needs assessment summary - 
chart. 



1 ~>* 



3/^fter completing the search and-selection section, the program pjanher will be* able to' 
use selectioncriteria to select a careerawaYeQess program to be implemented in the 
area vocational school described in the cass study. . * 

4. After completing the implementation section, the program 9 planner will be able to ' " 
complete a plan for the implementation oj a new career awareness program in the area 
vocationatoqhool described in the case study. ~ n % 

After completing the evaluation section, the prograrn planner will be able to complete 
an evaluation design to assess the effectiveness "of the new career awareness program 
implemented in the are£ vocational school described in the case study. - 



5. 



, j 

Tneprcfbl 



The Pour Majorjf ha$e$ 



prcfblem-solvingprocess has four-major phases.'needs fjpatJssment* search and 
selection, implementation, and evaluation. « x * 

As illustrated in figure 1, the process is "triggered 11 by needs assessment activities. These 
procedures are intended to analyze the gap between the current status of achievement of the 
school's specified gopls and the levehof achievement that is desired for each,goal. As a result of 
the assessment, a target area with a high priority need for improvement is identified and detailed 
information specific to the areaus summarized. . * 

* / - - * • ' •' ' ' 
The information from the assessment is used to focus the search and selection phase. 

During this phase, various resource^pools (e.g., state and national listings of products, 

commercial Vendors, other area vocational schools/and research and development centers) are 

searched to identify "products and practices that appear to match the needs in the target area. - 

The products identified are then screened and rated, byojsing^specific criteria or standards from 

the needs assessment, in order to select the best one or more for use in improving the target 

aVea. « * . 

* Once a product is selected, thellnplementation phase begins. A detailed plan for installing 
the product or practice is written* This includes the foajor activities needed to install the new Q 
product or practiced * . , 

The evaluation phase relates directly to*implementation. An evaluation, procedure is designed 
for each major implementation activity. The design assesses the quality of the actual 
implementation and the effectiveness of the new product or practice in improving the target area. 
The implementation plan and evaluation plan together become the^program improvement plan." 

" . * " s '. $ * * " ' 

Figure 1 displays the.es?ence of, the process. As illustrated in the figure, an alternative 
procedure is followed if an acceptable product or practice cannot be identified for use. In this 
case, the school would be likely to plan and follow a program development phase that would, 
allow school staff. to design and develop their own innovative program to meet their needs. This 
alternative couliMake many formats but should end with implementation and evaluation plans. 



' FIGURE 1 

A BRIEF OVERVIEW OF THE PROBLEM-SOLVING'PROCESS , 

^ \ 
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Twelve Milestones 

Because the problem-solving process appears to be sequential, a number of salient points 
can be identified. The term used to describe these key items is milestones. The twelve milestones* 
listed below refer to the critical events that should occur in order to ensure success as a school 
progresses through the structured procedure* Each milestone, although of major importance 
itself, is further broken down into more specific checkpoints Or steps that are addressed in detail 
in the text. (Note: the term school, in this sense, is used to describe the team of school 
representatives who are assigned or who volunteer to complete the process.) Thew^lve 
milestones are as follows: * * * 



. • Preliminary Activities r 

t 

1. The prioritiesfand goals -of "the school districtfare Identified and/or developed. 

**** 

2. The school district commits itself to participate in the process. 

(Note: All of the schoojrlevel milestones below relate to the priority areas identified at the 
district level.) 

• : Needs Assessmeht* * < 

4 c# ^ 

3. ^Target area of need is identified. 

v • . * 

4. Specific in-depth needs are identified in the target area. 

5. A detailed needs summary is prepared for the target'pro£lem area* _ ^ ^ 

• Searcy and Selection s- * \£.<c * x ~ ' ' v ?rv 

6* Alternative products and practices are identified. ^ . ; 

•7. Products and. practices are selected for installation. . , 

(Note: Alternative— If alltpcj>ducts or practices are reject<^^he ; S<^6bV^fll n&ed to lnte*>a 
l^rogram development phase.) \ v 1 ^. \ -t - 

, • Implementation * *ir^\' ' . - 

.8. The implementatiorvpjan for the products and practices selected is prepared and 
approved. ^ m < ^ ^ ^ 

• Evaluation , v - V 

9. Theevaluation design is completed in order to assess the effectiveness of the products 
and practices selected. . ^ A f , ' - * 

10, Products and pr^cttc^^re installed. - . : \ :: * 

- > * * *. < . 

^ 11. Products and practises are evaluated." 

12. Further program management decisions are made. 



Throughout the handbook, the.se twelve milestones— beginning with milestone three— are 
presented in great detail. Before they are addressed,; however, it is critical to consfder milestones 
one and two. These two preliminary activities are absolutely essential to the success of the 
process. They are presented in order to remind^ program planners that tt\e broad priorities of the 
school district must be identified. If such priorities are not explicit, they should be made so. The 
general target areas of need, a term used throughout this handbook, must be visible. The second 
point simply is that commitment of the school district also must be explicit. Without this "up 
front" commitment, the rest of the activities will be merely ^busy work." 



A Tool for Program Planners 

As indicated, we have 'selected the format of a handbook for a very simple reason: There is a 
great deal of material, some of which is very extensive, that already exists for program planners. 
After much consideration and discussion with practitioners, it was our feeling that a relatively 
concise but comprehensive too) was necessary, so that vocational school personnel could readily 
get a "handle" on this important process. The handbook, therefore, represents a synthesis of a 
number of valuable— and recommended— resptfTCSfc that have been developed nationwide and 
that are available to the work teams described in this guide. 

In this regard, we are indebted to those who have done previous%ork in this area through 
thejtesearch and Development Utilization program (RDU) of the National Institute of Education. 
The,RDU, a demonstration effort to disseminate educational materials, was aimed at helping 
schools clarify and solve local problems. Several projects supported by the RDU program were 
particularly relevant, e.g., the Pennsylvania School Improvement Program, the Georgia RDU 
Program, the Network System, and the Michigan Career Education Dissemination Project. 

Jk^SK^hors of this handbook do indeed look upon this guide as a tool for program planning. 
Almost readers will recognize t *the handbook has a number of elements that are found in 
rompetencwWUtgd learning materials. This approach was a conscious attempt on th£ part of the 
authors totffilize technique with which most vocational educators are familiar. This is precisely 
wfa^Ub^concepts of learning experiences play such a great role in the handbook. Learning 
experiences are, of cours<flfche heart of competency-based materials. They provide the user with 
a planned sequence of activities designed to lead to the achievement of the "terminal" objective. 
Certain components are often included in the series of learning experiences in handbooks of this 
type, e.g., background knowledge concerning the competency and opportunities to practice or 
apply the competency. Both of these elements are found in these pages. As the user will see, a * 
great deal of the focus is on practice. The handbook, again, is a practical vehicle or, as we say, a 
tool for the very important process of program improvement. 

' the format of the sections of the handbook follows a similar pattern: 

• Initial background information 4 ^ 

• The profile of the hypothetical area vocational school or, as it is referred to for the most 
part, the case study , materials 

• Case study information will be framed for your convenience * 

• Learning experiences that include the milestones (in a more detailed form of checklists), the 
detailed learning activities, and supplementary resources 

We trust that this will be a useful tool for you. 



: SECTION II 

* 

THE NEEDS ASSESSMENT PHASE 



Objective: 

< 

After completing this section, the program planner will identify the educational needs St the 
area vocational school described in the case study^and complete a general needs statement and 
a needs assessment summary chart. 



Purpofes: % — 

• {Jo present descriptions and explanations of needs assessment procedures 

• To provide simulated applications of needs ^assessment procedures. 



y 



Background Information on Needs Assessment, Level One; Target Afea Identified 

A needs assessment can be beneficial to a school in many ways since it usually is part 
of long-range planning. Because the selection and implementation of products and 
practices depend on an japcurate identification of needs, 9 thorough needs assessment is 
the first step in the program improvement process. A needs assessment is also crucial to 
evaluation,. for it helps establish the focus of programs designed to improve the outcomes of 
the entire educational 'process. A needs assessment provides data for future planning, as 
well as a basis for allocation of financial and personnel resources. Moreover, repetitive,, 
needs analysis can be used to determine whether ^or not fhe program improvement propess 
is working, i.e., whether the needs have been met* SQch an assessment can be an ongoing 
activity, can help modify an existing program, and can refocus objectives and content areas. 
Because educational needs are always changing, assessments must take placexegularly. 

»*Most educators are familiar with the definition of an educational need as the deference 
between an actual situation and a desired state, i.e., the difference between "what is\and 
"what ought to be." This is a discrepancy definition, in that it focuses on the absencex^a 
desired condition. When teachers talk of student needs in terms of some aspect df 
schooling (such as reading deficiencies), they are using the discrepancy definition of nei 
However.the problem with this definition is that it assumes knowledge of the perfect state 
of "what ought to be." Also, even if we know precisely "what ought to be," we may not be - 
able to obtain it. A better definition of need, therefore, may bethe difference between "wha4 

is" and "what is satisfactory." • 

* , 

The term educational needs often refers to student needs or deficiencies. Many other 
types of needs exist, e.g., program needs, staffing needs, administrative needs, and so.on. In 
a comprehensive assessment, school staff should consider a whole range of needs. Hence, 
a needs assessment is a systematic process for determining the difference between listing 
and desired levels of attainment. ' 

9 ' 0,4 

' WhaJ|makes a needs assessment systematic? We believe that it is systematic when ^ s 
initial gdffltare jset. Such goals identify "what ought to be" or, more accurately, "what is 
satisfactory" in student performance, program design? curriculum development, 
administrative staffing, and so^on. Thus, when we defme-needs assessment, we say that it is 
a process of obtaining and analyzing information about problems related to the established 
goals (Schriner 1979). * - 



Determine Priorities 

A needs assessment can be as simple as an inforfrial survey of student attitudes in £ 
single school or as complex as a nationwide student achievement test. When one does not 
havtf resources to perform an extensive assessment, the following steps .can be taken to 
determine priorities for program improvement: 

• Identify or develop goals. 

• Determine andjate the relative importance of each goal. 

- • Determine and tate the relative effectiveness of c.urrent activities aimed at achieving th< 
goals. 



• Identify target areas of n v eett*by looking at the difference bejw^en "what is satisfactory" and 
"what is," and by determining the difference between the inrfporferf^e of the goal and the 

effectiveness of current activities. „ ' % • 

• * v- - " . 

• Analyze the current status of c the targetafea to identify more specific needs. 1 

•' • : \. : > ' 

Guidelines for Writing a Needs Statement 

One of the barriersYo achieving program improvement goals te the lack of specificity in 
stating Xtxe problem. Compare the following two statements: 

• / "We have a communication problem among our faculty." ' 

/ "f A «V* » * 

I - • * i * 

•s "We use team teaching fr\ our building. Virtually all of us involved in teams are concerned 
with the* fact that we hpvernot given adequate attention to creating ways to share-innovative, 
ideas across teafns.-We heed 'ways of shariKglhat do not take up the time of .those to whom 
a particular idea is not relevent, but that will share enough detail so those v/)o are ■ 
interested* will kridw how to tty it in their own setting." 

The lattllff^a good "needs" statement because it satisfies three guidelines for writing a good 
needs statement, namely; ( 

• Whojs affected? Members of the teaching teams are affected. ."Virtually all of Us involved in 
teams are concerned . . ." . 

I> 

• What kind of a need is it? What is lacking is an adequate means for doing something. "We % 
. nee$ ways of sharing ..." , . 

. • What isUhe goal for improvement? How will the situation look wherr the goal has been 

achieved? In this case, the goal is not simply increased'Communications. It is the creation of 

- ■ ". . . ways of sharing thatdo not talke.time of those to whom a particular idea is not relevant, 
but that share enough*detaiLso that those who are interested Will know how to try it in their 
v own setting." „ 

The most important ingredient is the last item, that is, the specific goal for improvement. 
- However, this guideline is not always easy to formulate. Your situation may be complex, may' 
contain any number of major and minor goals, and may take pages to describe. Nevertheless, 
you must keep in mind that describing the situation is not the -same as writing a needs statement 
A needs statement •must address the three guidelines and should focus on only one improvement 
goal in the specific situation. 

Jn order to complete the problem-solving process, a .hypothetical area vocational school Is 
referred to throughout the handbook— in the initial profile that follows and in the case study 
materials below. - % . 
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Initial Profile of the Area Vocational School 

The school is in theHSenter of an area that is predominantly rural. Most of the 
population has worked on farms, in nearby summer resort hotels'and restaurants, 
in servtbe stations, and construction jobs. Most of the employment is seasonal. 
During the winter months, the rate of unemployment is high. The trend has been 
for children to follow the occupational patterns of their parents.. , 

y 

In the last five years, a distribution center for a large majl order copipany, an 
electronics manufacturing plant, several nursing homes; and a large ijiedTcaJ^ » 
center were built within a thirty-mile radius of the school. 



During the construction of these new industries, the school administrators 
and the management personnel of the industries worked together to develop- 
long-range pten for tfie schpol thatjwould provide needed entry-level employees.. 
The outcome of this planning^a^the addition of computer science, health 
services, and basic elecjtont6component repair courses. All of the new courses 
included coope«ttVework-study experiences in the industries. These courses 
wej^avflflable for student enrollment when each new industry opened. Five years 
"later, however, since only 25 percent of the students are enrolling jn these nejv 
courses, the school board is considering dropping them. The traditional courses 
(agriculture, horticulture, home economics, food services, auto mechanics, and 
construction trades) are still showing high levels of enrollment and placement. 

At a recent meeting of a local labor council, the representatives of the new 
industries expressed concern about their high labor turnover. Entry-level 
employees were moving into the area, staying only long enough to gain 
experience,, and thei> leaving for jobs in urban areas. They asked the 4 school 
administrators if something could be done to increase the number of students 
completing the courses that were designed originally to provide a stable source of 
entry-level employees for these industries. If the school could increase the 
number of students qualified for entry-level* jobs, the new industries would provide 
opportunities and internal training for job promotion. 

The school director, Mr. Joseph PhippSf reported this request to the school 
board. Mr. PWpps had been trained in tye problem-solving process and had 
received board approval to'use the process to idenjtify th6 sources of the current 
problems in the school program-and to find products and practices th$t .wpuld , < 
resolve them. The board appointed a ten-member area vocationakschotff program ^ 
improvement team (AVSPIT) to work with Mr. Phipps to seek a way to improve the 
effectiveness of the school in meeting the needs of the^local labor market and to 
expand the career.chojces of students beyond the traditional occupations of the 
region. The team members included a representative from the local labor council,. 
M member of the school board, guidance counselors from four feeder districts, 
and four instructional staff members. , 

Mr, Phipps also received approval to have the state-level regional . 
representative provide the team with technical assistance and resource materials 
as needed... , *«'.... 
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Learning Experience #1: Target Area Identified \ 

Needs Assessment, ^evel One, follows a five-step procedure described in the next section. It 
is a discrepancy analysis that identifies gaps between desired and 'actual outcomes. The 
checklist presents fhe steps to be followed in identifying the target areas of need. After you have 
studied the checklist and the previous initial profile for the area vocational school, .complete ' 
Activities #1 and #2. " \ 

\ 

Needs Assessment Checklist, Level One 

Milestone Three: Target area of need is identified. This milestone is based on the notion that 
successful program improvement must focus on clearly defined problems. 

Step 1. The existing school data in priority areas are gathered. 

» - »* 

i Step 2. Data are summarized and analyzed. 

, Step 3. The school profile is prepared, including all available bacKground data. 
Step.4. The first needs assessment meeting of thejteam is conducted. 

Hi 

School data summaries and profiles afe reviewed. 

Team reacts to all data. 

Step 5. The.general needs statement is prepared. This will define the school target 

' area tcbe improved. %, 



Learning Activities 

Mr. Phipps scheduled the first meeting of the team in order to initiate thef needs assessment 
The objectives of the meeting were to achieve consensus on priorities of the current program 
goal?, to achieve consensus on how effectively each ,goal was being met, and to identify the 
goajs that were most in need of improvement. 

• ' - f -f , , 

The following materials wertvprovided for use by the team: j ; 

• A^profile of background information on the area vocational school. 

• Data front* a statewide assessment of vocational education. The statewide Vocational 

' Educational Assessment included a section on attitudesitoward work and knowledge of 
occupations and careers. The students in the four feeder schpol f districts and the area 
vocational school scored in the top quartile of the state distribution on attitutes toward work 
but were in the lowest quartile on knowledge of occupation and careers. 

1 \ . . . 

• A goal statement from the school board of directors that focused on the following elements:, 



— Ijripro^ng unity find communication among staff \\ 

Increasing career awareness among junior high students in the feeder schools 4 
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—^Providing categories of .occupations to high school students\that will prepare them for 
entry-levej jobs in the new industries 

' * Maintaining training in existing traditional occupations in the area 

• ' Providing career awareness materials for the teachers, counselors, and students in the 

^ A feeder .schools and the area vocational school 

Activity #1 ^Identifying target area of need! Using the profile data and the additional 
information p'rovided by Mr. Phipps.^ complete the .chart on the priority rating of needs. For your 
assistance^ column 1 already is completed. Use your judgment and the information you have or^ 
the school to determine afhd rate the current' level of effectiveness foVeach.goal; put this rating in 
column 2. For each goal, subtract column 2 from column 1 in order to arrive at the degree of 
need for improvement for each goal in column 3. (Remember 5 = high; 1 = low.) The number in 
column 3 indicates the amount of "need— the greater the number, the greater the need. Zero or a 
minus value in column 3 indicates no need for improvement. Complete Activity #1. 



Activity #2: Preparing a general needs statement Use the guidelines found on page 9 tor ' 
writing a neefds statement, the school profile, and the information gn the suggested answer sheet 
(Chart 2) tQ write a general heeds statement for the school. Cheql? your general needs statement 
with the suggested answer sheet. Complete Activity #2, 



Case Study Continued 

Conclusion of needs assessment The team decided that the general needs statement should 
bg Shared with the area vocational school staff and the school board. They also-concluded that 
additional data on the current status of the career awareness program in the school and the 
feeder schools should be collected. 



After completing- Activity #2 and reviewing the above conclusion, proceed to Background 
Information on Level Two: In-depth Assessment 



* ' ' 



CHART 1 



PRIORITY RATING OF EDS 



» * 

* - 
Goals* 


1 . - 2 


importance 
Rating 


f Current Level of - 
' Effectiveness Rating 


! v 
Need 

Rating 


To improve staff communication 

* 


• 

J 


o . < 

i 

* • - » 




To increase career awareness 
among students inthe arei 
vocational school and feeder 
schools encourage enroll- . ' / 
ment in the new courses 


• ' 4 


I 

m\ - 


- 


To provide courses for area^ 
vocational school students 
that will prepare them for 
entry-leve*! jobs in the, new 
industries in the school 
servicearea 41 


' 5 . 


• '* 

i • * • 




• * 
To maintain training for area 
vocational students in the 
traditional occupations in 
the school service area 

* 


r 4 


* * \- i - 


< 

* 


To provide career awareness 
materials for teachfcrs, counsellors, . 
and students in thrarea vocational, 
school and the feeder schools 

- 7 ■ * 
'* • i 2 


4 


* - 


. • V v 



- ; 



Compare your responses With the suggested answer sheet?#roceed to Activity'No* 2. 
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PRIORITY RATING OF NEEDS: SUGGESTED ANSWER SHEET' 



« 

Goals 


1 A ^.<£-;V?8- s 


Importance * 
Rating 


Current t^^Af ? ^v*^ 
Effe<rtiven«^ : BV^0 v 

> — > — li ■' 


\ Need- 
: : . gating 


• * 

Tp improve staff communication. 


- 1 




? — 4 

< - 


To increase career awareness 
among students in the area 
vocationafschool and feeder 

c/*Hfinlc tn orinWi i rano onrnllmont ■ 

in the new courses ^ 

» 


4 


• i / , . " 

> 


/ 


To provide courses for area 
vocational school students * 
that will prepare them for , 
entry-level jobs in Jhe new 
industries in the school ; 
service area 


5 


- V I '-. 

5 * % 

\ o 


• ' 0' 

\ . 

i f 


To maintaip training for area, 
vocational students in the w » 
traditional occupations in - 
the school service area * 


4- 

•v. 


<* 

\ — a — : e— a 


-1 ' 

* * * 

— * 


To provide clfeet. awareness * 
materials for teachers, counselors, 
and students in the area vocational 
school and the feeder schools 

' ■* * 

•s. 


• 4 


v • • 

2.- 4^\- 

'. ' ■ . / • 


,. 2* .* 



# Gpals with;highest.priority that need to be assessed. 



* 
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CHART 3 

* ■ * 

GENERAL NEEQS STATEMENT 



Who Is affected? 



I;erjc:v 



ofyn< 



What kind of> need It it? 



* 'ts 

What are the goals for Improvement? 
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CHART4 



GENERAL NHEQS STATEMENT: SUGGESTED ANSWER SHEET 



Who is affected? 



- The junior high students jn the feeder schools, the area vocational school 
studenter the counselors in the feeder schools and the area vocational school, the 
teachers of the<new vocational s'chool courses, and the new-industries in tttfe areas 
served by the school all are affected by; problems related to career awareness and 
school training in occupations available in the new industries. 



y 



A 



What kind of need is ft? 

9 Although adequate career awareness materials have been provided for the 
teachers, counselors, and students in the area vocational school and the feeder 
schools, there have been no improvements in the career awareness or career 
knowledge of junior, high school students. While courses that prepare area 
■ vocational schools students for employment in the new industries are available, 
enrollment in these courses is low. The vocational school is not meeting the. ^ 
needs of this new labor market. 



What is the goal. for improvement? " ^ 

More effective use of the available career awareness materialsjbyt^hers, 
counselors, ancf'students In both the area vocational school $M the feeder , . 
schools must occur. Current career awareness materials and activities must.be 
added to increase student career awareness and khowled^especialiy in those 
occupations related to the new jnduslnes. Student enrollment in the new courses 
♦must be increased to meet the current needs of the local labor market 
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Background Information on Needs Assessment, Level Two: In-depth Assessment 



After a target area pf need has been identified, it is necessary to complete an in-depth 
assessment in that area. During Needs Assessment, Level Two, in-depth analyses are completed 
on program* mateYials, administration and management, staff development, student services, and 
instructional programs. Level Two requires the team to focus on the following questions: - 

• Are the current program materials adequate? * ^ 

• Do teachers, counselors, and students have access to the materials? 

• Are the materials compatible with stated program objectives? 

• » 

%. 

• Where are the weaknesses related to the target area in administration and management, 
* staff development, student services, and instructional programs (including student 

\ outcomes)? 

• . . f 

To answer these questions, items must be written for survey questionnaires fiflld structured 
interviews. These instruments should have between four and six items for each question. 
Respondents should be selected frQm groups with dirept involvement in the target area, e.g., 
teachers, administrators, students, counselors, parents, and employers. Usually different forms 
are constructed for each major group of respondents. The items in each form will ask for similar 
information but should be phrased differently for each group. 

Data collected in Level Two are summarized and analyzed for each group. When this type of 
data summary is presented to a planning team, it is organized to show how each* group 
responded. The planning team would then use the data to produce a sumjriary chart that - 
specifies the major problems in the target area that appear to be in need oTirfiprovement. This 
summary is important because the data become the basis for selecting and implementing new 
products and practices in the target area of need. 



Ca*e Study Continued 

The program improvement team had reached milestone four and had 
identified the career awareness program aslhe target afrea to be improved. Based 
on the information available, it was their judgment that if the career awareness 
program were improved, most of the other areas of need (such as enrollments in 
the new courses) also would improve. 



the team now was awar e of the target area of need, but was uncertain why it 
was a problem. More information about the currant status of the career awareness 
program was needed before jt could begin to search for new products and 
practices. * ; . 

. 'A'i'THe team decided to' (a) interview Several teachers, counselors, students', 
parents, and employers and (b) send questionnaires to all of the. teachers, 
counselors, students, and to a sample of parents and employers. The team met 
with Mr. Phipps and constructed questionnaires and interview schedules designed 
to answer the following questions: ' . . ~ ' ' ' 



• How was the current career awareness program administered and 
managed? . 

. *■ 

V 

• What staff development had beeh conducted, 6.g.< regular inservice, 
counselor training, or preinsfallation staff learning? 

• How good were the materials? < r 

How was career awareness integratedTn the curriculum? 
• , How were the materials used? 1 

• Were employers and parents involved in any way? 



Items\were written for each question. The team then rdLed questionnaires to 
^ all counselors, teachers, and administrators in the area vocational schopl and 
* feeder schools and 'to a sample of parents and employers. Ihtervfews were held* y 
with a sample of area vpcational school teachers, junior high school teachers, *and 
guidance counselors. v * 

; The data from the questionnaires ^nd interviews.were analyzed and 
summarized by Mr. Phipps in order to be presented to the team. v 

* At the team meeting, Mr. Phipps-Drovided data summaries for review. After 
much discussion, the group reached consensus that the major problems In the 
career awareness program were as fottoter 

r • * * . ^ 

• Overall/Coordination and management of .the # program were lacking. 

• The 'current materials were outdated, of* poor quality, and narrow in 
4 scope. • ^ J • * 

' * <^ r * ' ! " • - - ■ • 

• Consumable materials had not been reordered when needed: 

r ,_ f Counseling services Tor junior high school students were'limited and 
^concentrated on cqllege-bound students. \ - 

• ' Materials had been placed in< feeder schools and the area. vocational 

school but were kept in a resource' room. 



^Counselfift and teachers didnot have any training in the use;of the 
canwr awareness program. 



• The career awareness program had been selected before the new 
courses hadjteen Installed and had ^very limited information qrt these 

. occupatlo^. * „ - ■ 4 ~ . . ( 

• .Neither parents nor employers knew anything about the career < . 
awareness programs: — * « • \ 

• . There were no*tecords to show that the career awareness materials, 
were used in. classroom instruction. 



• The. career awareness materials were not part of a comprehensive 
program but had been ordered fro/n publishing company "grocery lists" 
of products. 

I 

• Counselors did not see any relationship between use of career' 
awareness materials and student choice of area vocational .school 
courses. . 

• There had never been any pubjic awareness activities for the new 
. courses or for the career awareness program. 

.• Students did not know there was a career awareness program. 

• No effort had been made to integrate Career awareness instruction, into 
existing curriculum offerings. Thifc~situation resulted in inconsistency in 
student exposure to the career awareness program. 

• Counselors and teachers who had used the career awareness materials 
felt that the focus was more on developing a positive attitude toward 
work than on offering knowledge about a wide range of occupations. 



Learning Experience #2: In-depth Assessment 

After you have. studied the.Uevel Two, Needs Assessment Checklist and the continuation of 
the case study, complete Activity #3. 



Needs Assessment Checklist/ Level Two 

Milestone Four Specific in-depth needs are identified in the target area. This milestone is 
achieved through a comprehensive analysts of the current status efforts in the target area, in 
order to identify specific needs that are ; causing problems. * 

j> , Step/L Program materials are analyzed.' 




.Interest levels 



-—Variety 



' J — Compatability'with area vocatiortal school goals in the target area 
.Availability 



Quality (te it dp to date? Is it comprehensive? Are the reading levels 

. * appropriate?) L * 1 * m : . 

• ■ ... V >• < • \ \ y ' ts - 

, Step 2. . Major elements, in the target area are analyzed, using questionnaires, 
' Interviews, and observations. 



-^Adftinistration.and^anagemenV 
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—Staff development ^ 

Student services 

Instructional program 

Step 3. Data from Steps 1 and 2 are analyzed and summarized. 

Milestone Five: A detailed needs summary Is prepared for the target problem area. This 
milestone is achieved by reviewing all the data produced in both Needs Assessment Levels One 
and Two. 

The needs assessment summary is prepared. 

—Review all previously summarized matetjpls. 

Review data summaries on administration and management, staff 

development, student services, and instructional programs. 

Review the general needs statement from Level One. 

Prepare a summary xshart f6r thfe target area. 

L 

The total area vocational school staff reacts and accepts the summary chart. 

Reach a consensus on needs to address in the search and selection 

process. r n 

Learning Activities 

Activity #3; Preparing a needs summary chart. Use the list of prbbjtems stated previously and 
• the general needs statement answer she^t from Level On§*to complete the n followinjf chart. Limrt ^ 
the itehns in each column to four. Since there is.some overlap, you may want to combine several 
of the Level Tw|jprpblem statements into one* One statement already has been written in each 
column to get you^started. (Note: In a real jschool situation, the preparation of the needs 
assessment summary phart »s-a team effort.) When you have completed this chart,. check your 
responses with the needs assessment summary answer sheet. Complete Activity #3. i 



Stepl. 



Step 2. 



.CHART 5 . 
NEEDS SUMMARY CHART 



Administration and 
Management 


• . Staff 
Development 


Student 
Services 


— tr — 

Instructional 
Program 


Need a coordination/ 
management systenj 
for career awareness 


Need teacher 
inservice in use 
foe career aware- 
ness program 


Need career awareness 
counseling that pro-, 
vides information 
related to the occu-** 
pations available in 
# the new industries 


Career awar6ness.< 
program needs' to 
be integrated into 
existing curriculum 


* 


V ■ 


* 8 


'■. \ - 

km 




r 


t 




0 




• 


* * 






ft 






1 

• 




c 
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CHART 6 

NEEDS SUMMARY CHART: SUGGESTED ANSWER SHEET 



A i\ mtntcfflf mo/ 
Mu ml n IS liai 1 ¥0/ 

Managemm£ 


Old IT 

Development 


QtnHbnt 

Services 


• 

\ nsir uuiiunai 
Program 

• 


Need a coordination/ 
rrlanagement system for 
career awareness 

♦ 


Need teacher inservice 
in use of career aware" 
ness program 

r 

T 


Need career awareness 
counseling that pro- 
vides information 
related to the occupa- 
tion available iri the 
new industries* 0 


0 

Career awareness pro- 
gram needs to be 
imegrated into existing 
curriculum / cw ; 


Need some central infor- 
mation system on stu- 
dent progress in career t 
awareness program 

- 


Need counselor inser- 
vice in use of career- 
awareness materials 
for helping students\ 
select area vocational 
school program 

* 


Need to publicize the 
work-study program 
in the new courses * 


Career awareness 
materials need ^to be 
accessible to students 
and teachers 


Need a system for keep* 
ing materials up to date 
and for replenishing 
consumables ; 

* * 


Need to develop com- 
munication on career 
awareness between 
vocational school staff 
and employers 
v. ; ^ ** : 


Need to t^oaden coun- 
seling services in area 
vocational school 


Parents and employers* 
need to be involved 
in career awareness 
activities. 


Need a procedure to get 
materials out of resource 
room for use by stu- 
dents, teachers, and 
counselors 


?« * 
Need to get informa- 
tion on career aware^ 
nfcss program to 
.* r staff,- stressing its * 4 - 
value to student 
[choice of vocational 
* school courses . - 

* * 


k Negd to build compre- 
hensive communica- 
tion between feeder 
school and area voca- 
school counselors to 
provide career support 
system for students * 


Career awareness mate- 
rials need to be com- 
prehensive; sequential, 
and part of a total 
career awareness 
program 


Need to bring parentis 
and employees into 
the career awareness 
program/ 


\ - 

t 


» 

t . ' , 

V 


Materials should focus . 
on both student attir 
tudes and knowledge pf 
occupations ♦ 


Need s6me public 
relations activities - r; < 


*l ' ' . v r : 

it g> ; . • *c 


\ , , ... 

. o • - • 

• * 





Supplementary Resources 



Classification of Needs * . . 

Theje are many types of needs assessments, most of which involve analyses of perceptions 
of need, actual data on needs, or a combination of perceptions and actual datitfhe following 
classification from Adams, Cohen, Koble (1977) may be helpful: 

• Objective discrepancy analysis— This techniqueinvojves measuring student performance by 
such objective means as standardized tests and comparing the results to desired status on a 
set of established goals. 

• Subjective discrepancy analysis— This technique involves measuring such things as student 
performance on the basis of the opinions of reference groups, e.g., teachers, parents^and ■ 
employers. • 

Self-perceived needs discrepancy analysis— This technique involves assessment of the 
opinions only of those beincfevaluated. For example, graduates of a vocational program 
might be sijrveyed to determine their perceptions of. how the program met their job-training 
needs. * * 

* 

• Interactive needs assessment— This technique invojves systematic interaction on the part of 
educators in a school building or system to generate^goals and analyze needs, 
■i * 

• Objective needs assessment— This technique involves the analysis of factual data from 
outside sources such as studeqt achievement test results from a large-scale assessment. 

• Subjective needs assessment— This techniquejnvolves use of a questionnaire or similar 
instrument to obtaig the opinions of respondents on the importance of goals or the 

t seriousness of educational needs. ; It 

Each category has its strengths and limitations. Subjective analysis, for example, has the 
.inherent danger of representing the bias of those surveyed. At the same time*, overreliance on 
external data, such as test scores that may not apply to a particular group of students, also can 
be dangerous. A combination of "hard," or objective, data and "soft," or subjective, data often 
will-provide the clearest picture of educational, needs. 



Additional Readings 

For more information on needs assessment, see Adams, Cohen, Koble (1977), a report of a 
-study^to assist in determining priorities for meeting vocational education needs fn urban areas. A 
"summaiy of this study also appears fn Ahmann (1979). Ahmann identifies types of nedtls 
assessment and Includes a discussion of several different needs studifes in vocational education. 
The appendices also list additional resources on needs assessment. 

L , - ; ; . - " ; : 

Three other^seful items are as follows: (1) Gray (n:d.) has written* pamphlet designed to 
help educators clarify their need statements. An example of a needs statement, statement of the 
target group, statement of goals arid ^expected results, list of criteria important to the resolution 
of needs, and suggested approschesjo the problem are provided. (2) Pennington (1980) also 
discusses concepts, models, arid characteristics of needs assessments. (3) Schriner (1979) 
presents a simplified treatment of the problem-solving process that includes a section on 
assessing needs and [ setting action objectives:* 



SECTION III 
THE SEARCH AND SELECTION PHASE 



Objective: 

After completing this phase, the program planner will use selection criteria to 
identify a career awarenesssprogram to be implemented in the area vocational 
school in the case study. 



Purposes: 

• To present descriptions and explanations of search and selection procedures 

• To prpvide simulated applications of the search and selection procedures 
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Background Information* 



Once yo*j have identified the school's needs, you may choose one of several options. For 
example, you may decide to maintain your present program with some minor modification. On 
the other hand, selecting new products or practices may be a feasible course of action. Another 
.alternative, while costly and time-consumirfg, may involve developing a new product or practice 
if you are unable to locate useful materials. This is not to say that the introduction of a new 
product or practice will immediately solve major educational problems. Nevertheless, an 
innovation that is adapted to the school can be a major step in the educational improvement 
process. Much .literature on the diffusion orspread'of new concepts is available. Many federally 
funded projects have'been based on this concept. In fact, the four major steps in the problem- 
solving process were successfully documented under the Research and* Development Utilization * 
(RDU) program of the National instituted Education. 

The selection of materials is basic to the educational process. Generations of teachers have 
searched for appropriate materials. In the present case study, however, we are not talking strictly 
about curriculum materials, although they might be regarded as innovations. Rather, any type of 
educational material (program or concept) with the potential for improving programs is regarded 
as an innovation. Furthermore, the term innovation in this context implies that the product or 
practice is based on£ound research and development and has proven to be successful in a 
variety of settings. 

In discussing this phase of the program improvement process, we will highlight thVee points: 
determining where to go for sound products, practices, programs, materials, or concepts; 
knowing what types of products or practices to select; and completing the actual selectiqn by 
using appropriate selection guidelines. 



Locating Useful Resources 

Educators are fortunate in having many excellent sources to assist them in their program *> 
improvement efforts. Unfortunately, it is sometimes lack of incentive rather than the absence of 
available resources that causes program stagnation. A major study of innovations*^ the Rand 
Corporation* found thatjocal schools sought and used new ideas when they needed them but diet 
' not seek out hew concepts when they were unmotivated by need (Bermati $nd McLaughlin * 
1975). * * ' * ' . ' ' 

At the same time, major information networks are available to those who are willing to - 
search for materials. In a working paper, Kbwle (1981) provides details on such major 
information resources as the Resource and Referral Service (-RRS)of the 'Research and 
Development Exchange (RDx) and other networks and resources for vocational education. 

Specific innovative materials may be obtained through each of the following sources. The 
Educational Resources Information Center system(ERIC) inciucfes'curriculum, staff development 
materials, and other documents unlikely to bepublished elsewhere.. The Resource and Referral' 
Service, located at the National Center for Research in Vocational Education at The'O^jip State 
University, provides -mini-lists c£ publications and programs in emerging ar&s. Requests for 
information are answered on an individual basis. The National Network for Curriculum 
Coordination In Vocational and Technical Educetion N (NNCCVTE) collects curriculum materials 
(excluding commercial items) [ri the vocational service areas. Their sjx regional centers are listed 
in the section on supplementary 'resources. * § \ 



Other excellent sources are available to assist program planners. As noted, the National 
Institute of Education (Nlfe) for several years supported the Research and Development* 
Utilization program to ensure that high-quality materials were selected §nd used by schools. 
State capacity-building grants provided funding for states in adopting innovations. The National 
Diffusion Network (NDN), funded by the NJJ^encourages use of innovations in probfem solving. 
NDN products and materials have the approval of the Joint Dissemination Review Panel (JDRP) . 
before local educators use them. This means that the innovations disseminated by the' NDN haye 
high standards of Equality. In fact, a repent study by the federal General Accounting Office notes 
that many districts would improve services under Title I if they adopted exemplary projects 
approved by NDN. A-comparison of approved and nonapproved Title. I programs indicates that 
approved programs often reported better results and were less expensive ("Few Title I Projects . 
1981). The catalog, Educational Programs That Wprk (1981), describes JDRP-approved 
innovative programs. Curriculum materials are not always, innovations and may* not be designed 
to promote educational change. In addition, some locally developed curriculum is ndt based on 
sound research and development and can not be used* in a variety of settings. Nevertheless, 
curriculum is one type of material most often sought by local sghools. ^ 

The National Network for Curriculum Coordination in Vocational and Technical Education is 
a good source of curriculum materials. However, there also are quality nonvocational sources as 
well; for example, commercial publishers are an important source. In addition, professional 
associations develop many quality materials. Research and development labs and centers §lso 
produce sound 'materials that are not alyvays submitted for J.DRP approval. The National 
Audiovisual Center (focated in Washington,^. C.) is an excellent source for films and nonprint 
media. < 

The National Center Clearinghouse at the National Center for Research in Vocational f 
Education produces the 'following relevant resources: 

• Program Improvement Data Base: Thfe program improvement data base contains 
descriptions of projects in two categories: (a) ongoing and recently completed cesearch and 
development projects in vocational education, including research projects,' exemplary and 
innovative projects, and curriculum development projects administered through state 
researph coordinating units and (b) federally administered projects related to cafeer ' 1 
educatjonr, vocational education, and education and work. Project proposals or summaries 
are acquired by the National Center Clearinghouse from states and # setected federal 
agencies. Information* about each project is processed for entry into 4 a computerized data 

- 'base maintained by a subcontractor, Education Service Group, an affiliate of Bibliographic 
Retrieval Services. - 

. The data base features ERIC descriptors for on-line subject searching and includes 

* nafn'es of project directors, organizations performing the worKv and funding amounts. . 
Information on the availability of reports and products resultinafrom completed program 
improvement projects has been addedrecently. In addition toits on-line search capabilities, 

* the data base is used to produce camera-ready copy for publication of abstracts. 

• Resources in Vocational Education (RIVE): RIVE is a series of publications that provides 
vocational education professionals with e%sy-to-use and current information about projects, 
products, and organizational resources. [ . - ' s 

State Program Improvement Projects: These publications contain resumes of state- .* 
<y administered program improvement projects in the areas of research projects, exemplary 
and innovative projects, and curriculum development projects. A subject index is 
included* . * • « *' 
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Dlrwtofy-OlVdcst : ^ 
nunfibersiHfe^^ 

Curriculum Vteso^ ^ ' ~~ 

instructional Mji\BX\^ ^ V'v : - # 

In summary, the selection of etfudatibHaH^ 

organizations. The key to successfulse^ -> 
choose those that best medt your;^ -V* 



. ^ ^ . 



Knowing what Types of Materials 16 SelecV V : : r ^ * ■*".--' , .r / -7 \. 

The types of materials selected w\ide^ example,. if. th$ " 

problem is one of student achievement fh baslc:m^ 

basic skill deficiencies is"a ^ikely choice. A problem involving time management might jequinelr 
consultant who,*in turn, would suggest an administrative plan. Not all the materials selected are, 
likely to be innovations generated by research ahd'deyelopment At the same time, when a major 
(change is called for, a tested exemplary program is more likely to produce successful results. 



Materials obviously take a variety of forms. They may be print or nonprint media and/or 
human or organizational resources. They may represent extensive programs or m^y be shirt 
handbooks, guides, information brochures, literature reyiews, and* other research-related 
publications. * - 

1 In addition to the national pool of exemplary products and programs, state andf local 
resource, agencies often may help you locate successful items that have been developed ahcL 
validated in a hlgh«sch0ol or area vocational school. In shqrj, although many resources^are ^ 
available, H is important to match resources and needs. . 




Some Important Guidelines / * . 

Before contactis made with sources of possible products or practices, some description of 
the type of item needed should beideveloped. While the description may be a narrative or an ^ 
toutflne, i^must include ttfe criteria that will be u£ed to evaluate the. products Available from the 
resources. Both the description and the school-specific criteria must be based on the needs 
Identified. In addition to the school-generated descriptions and criteria, other criteria related to 
the overall quality should be considered. 

" - < , 

The National Center for. Research" in Vocational Educatigp has developed a guide, Tentative 
Product Selection Criteria (1979), for , use in id&ritifyirfg materials selected for nationwide 
dissemination through its Dissemination and Utilization Program. The primary function of these 
criteria is to guide product examination and analyses conducted at the National, Center. When % 
criteria-based selection instruments are applied to available products, descriptive data,about 
them are generated. Careful consideration of these data ensure selection of the best apd most v 
appropriate products that are disseminated to vocational educator and their constituencies. * 



Ultimately, the selection criteria 4 are intended to serve the best interest of vocational 
educators; These criteria are used as a 'lens** for examining a great Variety of products. They 
. have been designed to be applicable to products and information pieces addressing a spectrum 
of^user needs and to analyze an array of product types. The systematic application of theViteria 
wiljiconsequently help vocational-educators as they seek to promote excellence in the field/ 



§|er!c 



41$ 



8 



^5 



35 



The criteria, which may be used by administrators in judging the 4 appropriateness of 
materials, are organized into* the following five categories: effectiveness, compatibility, contents, 
cost-efficiency, and research evidence of effectiveness. An explanation of each criterion follows. 

EHectlventtSvThe characteristics of the product shoufd be such that the effect *of its us.e will 
enable vocational educators to translate research and development results* into practical action. 
For example:*^ * •* 

^NThe prodpct should produce direct effects that are desirable and timely. 

. —Long-term effects: f The desired effect* should be produced for several years beyond * • 
immediate dissemination. * * . 

- * . • ] 

f , — Number/scope oteffects: The product should. help produce a variety of direct 
improvements. 

— Comparative effectiveness: 'Comparisons with other product^ having similar objectives s 
should reveal that the selected products are most appropriate for dissemination. 

— Flexibility/ adaptability: The product should be effective in a variety of settings and meet 
the ndeds of broad user groups. 

• Some products may be expected to produce indications of effectiveness, such as 
contributing^ the general knowledge in the field or providing a model for other work. 

Compatibility. Products that incorporate familiar and/or desired practices* and outcomes will 
tend to be most compatible with existing programs. They should contribute to the solution of 
problems with. a minimum of expense. Product orientation and staff development activities > 
should be reasonable and proportionate to the perceived need forlhe product. ' 

A desirable product helps solve a professional problem and/oj addresses a perceived need. 

— Priority of need: The product should address established priority areas on the federal, 
state, or local level. „ 

— Relevance: The product should be manageable to use and pertinent to the problem of" 
need identified. 

— Marketability: The product should bti marketable, exhibiting the follow/ng qfi%racteristics: 
meets a need; is affordable; is visually appealing and inviting; can be adoptedwithout an 

^initial long-term commitment; is exerpplary in^that it is superior to other prodaojs in * 
current use; is Qonceptually soynd; has been, proven by successfuUisej and produces 
outcomes that fhay be spread to othe/ users. * *■ \ 

• " * ' • . \ ■ 

• The product 5 can be directly and easily used for similar purposes in similar settings. • . 

— Practicality: The product should serve an obvious purpose. ' ^ 

/ • .•• -. .•• • " -. ; - 

— Timeliness: The product focuses on the most current and significant aspects of its theme. 

' . 1 - i r .:,, v '..*., , . 

— Credibility: The product should be believable in .its approach to the problem or need/ 



— Packaging*the packaging of the product should fake the following factors into 
consideration: storage, weight, durability, egsy identification of components, organization, 
and retrieyaVof components. & 



Contents The contents of the product should b$ presented well; should adhereUo accepted 
research methodology (where applicable), and should represent a good match, with the negds , 
and capabilities of the intended users. For example: , * 



• The product should avoid w6rds of illustrations that assign roles or characteristics to 
individuals on the basis of sex, race, qrspecial needs. ) 

—Sex.bias: Appropriate verbal and visual portrayal of both sexes should be evident. 

— Racial/ethnic bias: Minority groups are represented fairly. 

— Representation of special needs populations: The product should be sensitive to the 
needs of ihe handicapped, disadvantaged, limited-English-speaking, and other special 
needs populations. 

The product should communicate its message in a clear and compelling manner. 

0 

— Readability: The level'of language used in the product and the level of comprehension' 
^ required of the user should be in keeping withjts intended use. 

* 

— Consistency^ Layout and design erf the product should be consistent-Writing style should 
remain the same throughout the product. 

— Types of media: The most effective forms of audio, visual, written, or tactile - 

communication should be used. *7 

* > f — 

— Clarity/editing, physical quality: The presentation and format of the content should be of 
high quality. 

> The designrexecution, and presentation. of the content should be based on sound research 
and development methodology. , * e 



*— Suitability: The concept behind the product should be consistent with research and 
< development in that area. \ » 4 * 

—Accuracy: Content shouldlbe correct and current. 

—Balance/Scope/Selection: The most significant aspects, of the topic should receive major 
focus. The content should be presented in a nonbiased manner, 

'—Need for product development: The product should consider past research on the topic 
' and build upon existing resources in that area. * w 

—Completeness: The product should contain. adequate information on its development and 

intended use. ' " *y***r - • ^ • - ^ — - ~ - 

* ; ; ' : \ :% "* V ; " \ t % <\ v . ; 

— Cootribution:-The product should contribute to excellence in thp field of education. 
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• The content of the product should be compatible with the sharacteristics'of the intended 
users. 



• The format of the product should be appropriate for the intended users. 

• The product should provide evidence that it will raise the users' level of knowledge on the 



• The product should be attractive and interesting to the intended users. 

Cost-efficiency. Materials should be inexpensive enough to stimulate widespread adoption 
and yet provide enough revenue to cover costs. The following factors must be assessed in 
judging cost-efficiency: cost of acquisition, cost of maintaining the product shelf life, durability, 
technical qualities, and transportability of the product from one site to another with similar 
results. "Potential staff development costs also are important. The following considerations should 
be taken into account: 

• The extent to which background information is provided to usersrirforder to minimize the 
need for outside resources. / j 

m>- - ' 1 

• The extent to which there are special conditions for use. 

• The extent to which directions 4 are provided.for additional training. 

4 • ' The amount of additional training required. 

• , » I • 

Research evidence of effectiveness. .Claims and observation$*aboyt the effectiveness of a 
product should be verified^ith valid and reliable data. Nonexperimental studies of product use 
should indicate an association between the product and a desired condition (e.g., solution of a 
problem). Evidence should indicate that the effect of the product is of sufficient magnitude and 
that the effect can be thieved when the product is used at other sites. ' 

While instructional materials and other innovations may be judged differently, rating scales 
are available to assist in objective assessments. You may wish to modify or adopt one of the 
scales presented here to use as a basis for your product selection process. If your process is 
systematic and is based on established principles, you will be more likely to succeed in <+ 



topic. 




/ 



Case Study Continued 

The artfa vocational schopl program improvement team had shared the needs 
summary chart with the school staff and administrators and received approval to 
search for a career awareness program that would meet their ne^gs. Mr. Phipps 
contacted the state department career education representative and asked for 

^assistance in identifying products already successful in pther regions of the state. 

**«He also contacted the regional vocational education resource center, an 
informational retrieval center, and several commercial vendors in order to learn 
what was available. As a result he was overwhelmed, wrtri* catalogues and 
brochures. It was clear that future requests to thq&e agencies would have to be 
more specific. , % \ 

. The team met with Mr. Phipps in order to write a description of what specific 
type .of program was needed. Basdd on his training in.4he program improvement 
process,. Mr. Phipps askedHhe team to write'a brief statement defining what kind 
of a prografn they were looking for and to develop a list of criteria for selection? 

While the description was relatively easy to write} it was another story when it 
came to the criteria. The general description of the 1 type of qareer awareness ' 



prograrp they were peeking inqluded the following elements: 

• The program uses a variety of materials. * * 

• * * ■<* * * > 

• The a£bgratn provides adequate knowledge in a broad range of 
ocfflpations.' . 

• The.prbgram has special'focus on* occupations in the new industries. 

» • * 

• The program can be usedior grades seVen through twelve. ► • # * ^ 



« ; * ■ • J* 

Learning Experience #3: Search and Selection 



After you have studied the Search and flection Checklist and related reading Materials, 
complete Activities*#4 and #5. 

. :• 

Search aiid^Setectlon Checklist 

- Milestone Six: Alternative products and practices arejdentified ;Th\s milestone requjres 
matching the school peeds identified in milestone five with a $et of available products arid 
practices.. ' . / \ % T ^ 

# * - » . - * * 

Step 1 . Generate the selection criteria from the needs assessment summary report. \ 

] LStep 2. Locate the hrtajor sources of alternative products and practices. ' / \' 

j Step 3. Search the^resource pool for a set of approximately ten products that match 
the criteria. *• * 

- . ' ' ! I 
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FIGURE 2 . 
PRODUCT RATING FORM 



1 . Long-terrfl effects; 



1 

Low 



2 

Moderate 



High 



Points 



Has little potential to affect 
vocational education 
priority areas jpeyond 
initial dissemination. Will 
provide little to reinforce 
directions of improvement 
in vocational education 
research, development, and 
practice. 



Has potential to affect . 
vocational education - 
priority areas beyond 
- initial (dissemination. Can 
reinforce defections of 
improvement in vocational 
education R&D. Can stimu- 
late excellence in vocational 

• vocational* research, develop- 

• ment, and practice. 



% < 



2. Number/scope of effects: 



1 

Low 



2". 
^Moderate 



•3 

High 



Points 



Will produce few direct improve- 
ments in vocational education.. 
Association with desired 
trends in vocational education 
practice is unclear. 



Will help produce a varjety 
of dfrectjmproyements in * 
j/ocational ecftjqation. Is 
clearly associated With* v 
desired trends in vocational 
education^practicej 



3. Comparative effectiveness: 

♦ 1 
' Low 



2 

Moderate 



3 

High 



' oPoints 



Other identified materials with 
similar objectives are more 
fitting for nationwide 
dissemination. 



4. Flexibility/adaptability: 
1 

Low 



When anajytically cprnpBred , 
to products.witt^similar ? a ' 
objectives is. the most fitting * 
for nationwide di&eminatfon* \ 



..2, 
Moderate 



, 3' 
High 4 



" Points 



Applicable in a wide variety ; ^ %; 
pi settings. Meets therneeds^ . *" ? 
of broad user groups. ^ jo 



i Applicable in few vocational 
education settings. Addresses 
the needs of user-groups that 
are too narrovy for network 
dissemination; . 



Comments: 



Modification Requ ired : 



Milestone Seven: Products and practices are selected for installation. This milestone requires 
extensive screening*and evaluation of a group of alternative products and practices in order fo 
find the best "fit" between school needs and one of the products and e practides. 

, • Stepl. fleview .the products. . 

s ' • i * • 

x "v ' * . 

. Screen the set using ttreselection criteria. 

Eliminate all but three or four products. * - 0 

Step 2. Select the product or practices. 

^—Consider the total staff rating-of *be products. **\ 
• » . — — Prepare'the summary of ratings. 

Select the products (or practices) to be installed. 



Or alternative Step 2. If all the products are rejected, begin a curriculum 

^development process, a development process for management activities, '^nd 
simffarngctivities as needed. 

Identify the process. ^ 

• Develop a plan to implement the process.- * • ► 

. Initiate ttle process. 

Ltarnlng Activities 

!f\ - 

The team members met with Mr. Phipps to clarify their'.description of the kind of career 
awareness products they wanted and to develop criteria for use in locating and selecting them. 
Mr- Phipps suggested that some criteria could come*frorn the needs summary chart developed at 
the last meeting and the criteria for product selection developed by the National Center for 
Research in Vocational Education. He also developed dn additional list from a review of the 
research literature. The criferia'from the National Center were stated previously. The additional 
criteria from the literature— particularly the, work of Ball, Marvin, Temkin (1975)— included the 
following points: V * ' « > - * 

. , i 4/- 




clear objectives 

appropriate scope 

• logical sequence 

content alccuracy and detail 

appropriate grade and 
difficulty* level 

varied learning 
activities 

information on pupil 
performance 



l 



provision for review 

extent of individualization 

appropriate cognitive level 

provision for staff training 

ease of student use 

.attractive format and 
appearance 

4 

equipment required 
facilities required 



• organizational staff 
changes required 

• reasonable cost 

.• expert authorship 

• T&ults of formal evaluation 

• resu Its pf informal^ 
evaluation * * 

lack of bias 

• interdisciplinary approach 

• local acceptance 



Activity #4: (Criteria development) Using the criteria of the National Center, the list provided 
by Mr. Phipps, and the needs assessment answer sheet, the team prepared a set of criteria and a rating 
sheet to be used in selecting a career awareness program. A partially completed product rating chart 
is presented below. Using the information with which you have been provided, fill in the additional 
criteria. Check your responses with the suggested answer sheet that follows. Complete Activity #4. 



CHART 7 
RATING CHART FOR CRITERIA' 



Rating. 
Scale: 



: 0 


■ 1 


2 


3 




Not at 
All 


Some 
^ Extent 


1 Moderate 
, Extent : 


\Large ' 
Extent 


4 

Completely^ 



Instructions: Rate the programs using the rating. scale provided above. 



Criteria 


Program . 
A 


Program 
B 


Program 
. C 


Program — Program 
D K ^ 


1 lc rnrnnrohoneii/D in 

i. is ouinjj r cnciisjvc in 
scope'and sequence 


• - 










2. Includes a strong focus — 
. on occupations in the 
area's new industries 
(health services/com- 
puter science, etc.) as 
well as traditional 
occupations irt the 
region t 

* 




* * • 






<* 


3. Is reasonable in 
cost 

j 






* . > 




f 


' 4. Includes staff develop- 

• ment materials and * 
* services 




* * 




'I ' 




. 5. 

: -■•/ - 




H 




* 




6. - 

4 
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CHART 7 - Continued 



Rating 

Scale: 1 



0 


1 


• m 2 


" 3 


4 


Notat 


Some 


Moderate 


Large 




All 


Extent 


Extent 


4 Extent 


Completely 



Criteria 


Program .« 


Program 
B * 


Program 
C 


Program . . . Program 
D * K 


7. , 

« « 












8. 

< * 


V* 




• 




m 


9. 






• 


• * 


i 


10. 






4 






11. " . 

c 






V 






12. * 




* 








13. 








0-. 
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CHART 8 . 

RACING CHART FpR CRITERIA: SUGGESTED ANSWER SHEET 



Rating 
'Scaler 



0 


1 


,2 % 


3 


4 


Not at 


Some'* 


Moderate 


Large 




All 


Extent 


: Extent 


Extent 


'Completjgjy 



Criteria 


Program 
A 

* 


Program 
B 


Program 
>C 


Program . . . Program • 
D K 


0 

1. Is comprehensive in 
• scope and sequence 


n 










Z Includes a strong focus * 
on occupations in the 
area's new industries 
(bealth services/ com- 
puter science, etc.) as 
well as traditional 
occupations in the 
region 








9 

1 


• 


*3 Ic rPAQnnahlp in 
O. la 1 CaDUllaUIC III 

cost 












4. Inclu.Jes staff develop- 
ment materials and 
4 services 


♦ 


•* 








# 5; Ihcludesa management 
- -\ and coordination system 










* 

X 


6, . Has a strong knowledge 

component in a wide 
, range of pareers / 
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CHART 8 — Continued. 



Rating 
Scale: 



0 


1 


2 / 


3 


4 


Not at 


Some 4 


Moderate 


Large 




< ah 


Extent 


fextent 


* Extent 


Completely 



Criteria 


Program 
A - 


Program 
B 


Program 
C 


Program.. A Program 
D K 


• 

7. Is compatible with * 
current materials 












& Has evidence of 
effectiveness 


- 

/ 










-\— — — 

9, Is suitable for the 
students in the area 
vocational school 




/ 


• 


) 




10. Is adaptable and 
flexible 












11. Includes strategies for 
parent and employer 
invqlvement 




r 








c 

12. Includes material and/o* - 

pro<jedure$for public . 
. / relation activities 

' 4 t t * 


4 • 

J i 




* 






i •* 

*■ . t 

J3. Is »bias free . , * \ - 






•a 







:4 
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Case Study Continued 

, The description of the desired career awarer^ss product* and the list of 
criteria were sent to the regional resource center, the information retrieval center, 
and commercial vendors. The information and sample materials for the career 
awareness program? were received. Using the rating scale, the team analyzed the 
responses and narrowed the identified products to the foHowing'three programs: 

Program A is a*comprehensive program with student, guidance, andW 
classroom materials for grades seven through twelve. It provides strategies and 
forms for management and coordination of the totaLprogram that should Vesult in v 
integration with the regular curriculum. Student record logs are part of the 
system. It doesjiot require expensive hardware; the software is compatible with 
o the existing available hardware. A wide range of occupations Is covered and there 
is an emphasis on knowledge about each- career. About 50 percept of the content 
focuses on the occupations 'related to the new. industries in the school service 
area. The cost to install it is $20,000, with an average annual cosf of $2,200 to 
update the content and replace consumables. The developers provided evaluation 
data on effectiveness. Its history of use in both urban ariWural area vocational 
schools supports its flexibility of use. Reading materials are provided in reading 
levels ranging from 4.5 to 8.0. Racial, sex, and handicap bias is not present. The 
"materials have precisions for staff development. - . 

■ 

■ Program B has a strong knowledge component but is limited in <• 
"comprehensive coverage of careers. There is no management system. Although ' 
staff training materials are available, it is a service package from the devqjoper. 
installing it would require purchase of expensive hardware and modification of 
school facilities. The installation costs would be $75*000, with an annual cost of 
,$5,000 to Maintain it. The developer? claim it could be made compatible with the 
current program bJl do not say how this will be done. While most occupations 
and careers are c<^ered, there is~no extensive information on the occupations in 
the new industries in the school service area. The developers providefevidence of . 
effectiveness but only in large urban centers. There are no provisions for special 
needs students; several incidents of sexual- bias in the materials are evident. 

Program C is low cost ($10,000 to install) and has no anntial cost except,, 
when the school wants to add components. It has a management and 
coordination system and a moderate amount of staff development material. 
Although it lovers a wide range of careers, there is limited material on the 
occupations in the new ipdustriea in the school service area, it appears to be 
compatible with current career- awareness materials. The developers provide t 
limited evidence of effectiveness, although testimonial from users are available, It / 
* is suitable for students for grades nine to twelve. Materials are attractive but 

_ jim^ ; * ** f^r*. r -- - - 

The total area vocational school staff then examined these programs and s 

rated them. ; - — » -~ * ' ■ • 

t % * 

- Activity #5; Using search and selection criteria. Use these program descriptions to complete 

Chart 9. Decide what you think tfce average schooi staff rating would be for each program on 

each criterion. Compute the total rating for each program. The program with the highest rating - 

will be the one selected. in order to get you started; some of the ratings have been'filled in. . 

Compare your final selection with the suggested answer sheeiJGhart 10): Complete Activity #5. 



CHART 9 

RATING CHART FOR PROGRAM SELECTION 



Rating/ 
Scale: 

/ • 

I 

\ / *• 



0 


1 ' 


2 


^-3 


^4 


Not at 


Some 


Moderate 


Large 




Ail 


Extent 


Extent 


Extent : 


Completely 



Instructions: Rate the programs using the rating scale provided above. 



* Criteria 


' Program 
A 


Program 
B 


Program 
- C 


Program.... Program 

D. K. 


•1. Is comprehensive in 
Scope and sequence. * 


4 

0 


2 

• 


\ 0 . 






2. 'Includes a. strong focus oh 
occupations In the area,'s 
new industries (health 
services, computer science, 
eto.) as well as traditional . 
occupations jn4h&region 


• 

• 


i 

• * 


\ 

% 


HO' 

* 

4 


> V 


. , 

«3. Is reasonable in cost 


I 

V 








* 


4. Includes staff develop- 
. rrient materials and ^ 
services • * \ 


2 . 


; r 2. 


3 " 




* 


5, .Includes a management 
and coordination system 








/ y 




6* Has a string knowledge ^ 
component in a v^fde' ^ 
range of car^ef^ 

9 ' 


r * 




* 

* 








CHART 10 

RATING CHART FOR PROGRAM SELECTION: 
SUGGESTED ANSWER $HEET 



Rating 
•Scale: 



. 0 


" ' 1- 


2 


3 


4 ' ;> 


Ndtat 


Some 


S Moderate 


Large 


1 


All 


Extent 
<5— 


f| Extent 


Extent 


Completely 



Instructions: Rate the programs using the rating scale provided above. ► 



' ' • ' It — 

Criteria 


Program 
A 


Program 
B 


Program 
C 


'Program. . 
D 


. .'Program 
K 


1. Is domprehensive in 
scope and sequence % 




2 


c 

0 


V 




2. Includes a strong focus 

on occupations in the 
* area's new industries 
(health services, computer 
"science etc ) as well as 
traditional occupations 
in the region 




0 . 


1 




- 


3. T Is reasonable in cost 


2 r 


>i 1 


4 


■ m 




4. Includes staff develop? 
^ment materials and ^ 
•services 

* 


2 


2 


•'•3 




\ 


* •* 

' i . 

5. Includes a management 
* "and coordination system 

* =^ 


■ ■' 4 


0" ' 


2 






■* * 

6* . Has a strong knowledge 
cdmponent in a wide 
t range of careers 


4 


2 


.4 

4 







Rating 
* Scale: 





















* * 


* * 












• 

• * 




CHART 9 - Continued 


•> 


• 


0 

Not at 
Ail . 


Some 
Extent 


* 2 

Moderate " 
Extent 


3 - 

J Large " 
Extent 


4 

Completely 


* 

*> 


- 






* 




1 * * . 



Criteria 


Program' 
A 


Progfam 
B 


Program 
C 


Program — Program 
D K 


7. Is compatible with 
current materials * 










* 


8. Has evidence of 
effectiveness 


- 








> 

• > • 


~ — % 

9. Is suitable for the 1 
^ students in the area * 

vocational school ' fe 


3*^ . 


^ 


IT* ^ 




■ <* 

i 


* ■ 

1t>. Is adaptable and 
flexible 

» 


■* #| 


* .■* 

- o 
** 0 

* > * * 


* o fc . . * 




, t 


1 1 • Includes strategies for 
parent and employer 
involvement \ 


/ 

' o • 

\ • 




*' o ' 

f ' . 




• r 


' . 7-' ° :■ ' 

1 2. , Includes material and/or w 
procedures for public 
\ .relations activities 


I 


' /. . • 


t - ** 




v., 


1 3. ^/s bias.fr ee 








• 3 * 


. i * 





■ 



- -» fee ' 



•'St;' 

» » 

- - J- --A 



CHART 10 -Continued 



Rating 
.Scale: 



0 




2 


3 


4 


foot at 


Sdmf 


Moderate 


Large 




Alt- 


Extent 


Extent 


Extent- 


Completely 



Criteria ' - 


Program!' 
> A 


Program 
B 


Program 

-V c 


Program.. 


. . Program 


7. lscompatible,with 
current materials 


* 

3 


2 


. 2 






8. Has evidence o\ 
effectiveness 


A 

4 




i 




1 


9. Is suitable for the students 
in the area vocational 
school 


3 


2 


3 




1 


10. Is adaptable and 
flexible . 


3 


0 


* 2 


-i 


• 


= z — r* — ■ a : 

1 1. Includes strategies for 
parent and employer 
involvement 


• ....... / 

4 

• 


0 


3 • 


* ? 

t 




12. Includes material and/or' 
procedures for public • 
Telatibns activities . . ^ ,\ 


4 


2 








13. Is bias free 


' 3 ' 


0 


* i 
3 






totals: 


43 


• 15 


28 







Although many economic, social, and political considerations influence the decision- 
making process, the final decision of which career awareness program ttf install must be 
basecl on sound educational program criteria. Which career aWareness program is best 
suited for meeting the instruction or program needs of the area vocational school 
discussed in the N Case Study? * 

* * * 

Answer Career Awareness Program % is tjest suited to meeting the instructional or 
program needs of the area vocational school. Program A received the highest overall rating; 
in terrhs of the educatfo/ial program criteria listed in Chart 10. , > 




Supplementary Resources 

Additions! References 

*For more information on thaselection process,, you may wish to read Select Student 
Instructional Materials (1979), Module.B-5in the Performance-Based Teacher Education series of. 
the National Center for Research in Vocational Education, Designed for teachers, this module 
includes questions to ask in selecting materials and an exercise on using the Flesch formula for 
determining readability? 

Use Information Reso'urces.to Help Solve Educational Problems by Kowle (1981), a, working 
paper in the Competency-Based Vocational Administrator series of The National Center for 
Research in Vocational Education, provides an overview of information resources, 

A Minicourse on Selecting Resources for School Improvement byTrohoski (1980) is a self- . 
guided course on selection based pn JheJPennsylvania School Improvement Program, The 
course is divided into the following sequential areas: introduction to selection, committee^ 
developed ground rules for selection, Specific selection criteria development, practical 
application of the selection criteria, and a selection summary. A booklet on sex fairness 
considerations and a brochure on the National "Diffusion Network are included. 

The National Network for Curriculum Coordination in Vocational and Technical Education 
(NNCCVTE) collects curriculum majterlals^excluding commercial items) in the vocational service 
areas. The six regional centers of NNCCVTE are as follows: 

Northeast Network Curriculum Coordination Center: States served— Virgin Islands, Puerto Rico, 
Rhode Island, Vermont, New Jersey, Connecticut, Maine, Massachusetts, New" Hampshire, New 
York . 

v 

! 

Bureau of Occupational and Career Research Development 
bivision of Vocational Education ^ 
225 West State Street 

Trenton, New Jersey 08625 ** • ' . v \ 

(609) 292-6562 r x '^ ! 



Southeast Network Curriculum Coordination Center: States served— Tennessee, Mississippi, 
Florida, Georgia, North CareltoarKentucky, S^Jth Carolina, Alabama 

Associate Dean (R&D) ^ / . 

College of Education * . 

Mississippi State University # "... 

Drawer DX ' c . 

Mississippi State, Mississippi 39762 ♦ 

(601)325-2510 JT" * * - ' Q 




East Central Network Cugiculum Coordination Center: States served— Illinois, Delaware, 
Pennsylvania, Minnesota, Indiana, West Virginia, Virginia, Maryland, Ohio, Wisconsin, Michigan, 
also tKe District of Columbia m 

« 

Illinois Vocational Curriculurp Center 

Sangamon State University, E-22 . a < ^ 

Springfield, Illinois 62708 * 
(217) 786-6600 

Midwest Network Curriculum Coordination Center States served— Oklahoma, Arkansas, Texas, 
Kansas, Missouri* Nebraska, New Mexico, Iowa, Louisiana 

State Department of Vocational and Technical Education 
1515 West 6th Avenue 
Stillwater, Oklahoma 74074 % 
(405) 377-2000, ext. 261 



Northwestern Network Curriculum Coordination Center States served— Washington, Alaska, 
Colorado,' Idaho, Montana, North Dakota, South Dakota, Oregon, Utah, Wyoming * 



Washington State Commission for Vocational Education 
x Building 17, Airdustrtal'Rark, LS-10 
Olympia, Washington 98504 ' r 

(206)753-0879 • 



x 



Western Curriculum Coordination Center States served— California, Arizona, Hawaii, Nevada, 
American Samoa, GuamT Trust Territory of Pacific Islands 

University of Hawaii^ 

1776 University Avenue WT21'6 ' 

Honolulu, Hawaii 96822 . 

(£(08)948-7834 



Principles for the Selection and Use of Instructional Materials 



A number of important principles for the selection and use of instructional materials should 
^considered. The*following is a valuable guide? ' * . . 

—Provision is made* for securing a 'wide , variety of good instructional resources^ 

The schopl system prepares an inventory of community resources that can be used to 

enrich the curriculum. 

, A school system instructional materials center is provided with an adequate Supply of 

appropriate instructional resources readily available for use by teachers. 

Provision is made for sharing ideas on resources by teachers in the school system 

through such means as newsletters and teachers' meetings. 

Teachers are informed about free and inexpensive. materials. 

-Teachers iiave available to them a variety of curricular materials to meet the differing 

individual needs, interests, and abilities of ail their pupils. 

Theschool system applies criteria in the selection process for books and other materials 

thatk purchases. , 

Classroom, teachers participate with supervisors in a team approach to select 

instructional resources. 

Teachers are invited to serve on selection committees on the basis of their experience, 

teaching competence, individual judgment, resourcefulness, and interest in serving on 
such a committee. • 4 

Members of instructional resources selection committees participate freely in reasonable 

"give .and take" discussions With individual representatives- of curricular materials firms. 

Adequate released .time is provided for teachers.to do. a thorough job in their study. ' 

^Publishers are notified in advance by letter'of pending adoptions, the kind of materif Is 

v desired, the plans for interviews, and the schedule for hearings. 

__When studying textbooks, selection committees are encourage^ to study carefully 
^materials accompanying the texts such as teacher's guides, workbooks, tests, and other 
helps. \ * ' \ 

—♦.Proper inspection, trial, anj/compa^son by the selection committee, using criteria based 
^oft the goals of the schtdr system, are used as the basis for determining . , t 

' recommendations. .< * 

* _lAn adequate ^library of professional resources Js.available to'teadiers. 

Teaphers are.made Jhorougtfy Mquff^ed with instructional resources that are available 

and with ways in whtch these may-be used. - v ' . 



-.Evaluation of instructional resources is carried on as a continuous activity rather than as 

an operation that takes place hastily just before the purchase of them. 

* 

_The inservice education program on new instructionaj resources helps teachers make 
effective use of them. ' 

* 

Provision is made for regular inspection, care, and upkeep of materials. 

* 

The instructional materials are properly cataloged and stored. 

The instructional materials are multiethnic and meet conditions of sex equity. 

The public is kept informed about the materials and equipment being used. 

Supervisors help teachers guide their pupils to develop creative instructional materials in 

the classrooms. 

Faculty members are encouraged to display creative materials prepared by pupils in an 

attractive manner on bulletin boards ancHn classroom exhibits. 

Leadership and time &re provided in the inservice program for teachers to work together 

in the preparation of instructional materials. 

Field. trip and community speaker resource guides are prepared for use by teachers. 

——Thorough use is made of eduoational technology in the instructional program. 



SOURCE: Lloyd W: Dull, ed. t Leadership Practices for Director of Vocational Education 
(ColumbusfOH^bhio Department of Education, Division of Vocational Education, 1979), p. 91. 

Checklist of Considerations in Selecting Instructional Prografns 

.Similarly, several ustffuf gujdes have been developed to assist the selection process. The 
following is aft excellent example: ^ ^ ; 

—*~:Ouftom0s. Are expected outcomes specified stating whaMfJT&icienties learners will 
Squire as a result of instruction? - 

^—Assessment Are measures included that frequently assess' pupil-progress towards 
- instructional outcomes? *■ r 



■A' 



£7 



—.User Experience Data. Are data presented to indicate that (a) outcomes have been > 

consistently attained during previous usf of the prpduct jn awide/ange of situations and. 
(b) learners, teachers; and others involved in the program have expressed satisfaction 
with the. product? lp 



— Materials: Are instructional aijd supplemental materials and activities included that are 
keyed directly tp the expected instructional outcomes and assessment materials? 

Training^Are materials and procedures included for training teachers and other school 

personnel to use the instructional resources effectively? 

Reporting. Are materials and procedures included for teachers and administrators to* 

credit the instructional accomplishments of pupils in 'a form .understandable to parents 
and the public and to identify learners who require instruction beyond that provided with 
the product? 

Time and Costs. Are the time and cost requirements for establishing and operating 

instruction with the product acceptable to those involved and reasonable in terms of 
expected outcomes /for /learners? 



SOURCE Adapted from. Considerations in Selecting Instructional Products: SWRL Instructional 
Product Selection Kit (Los Alamitos, CA: fcWRL Educational Research and Development, 1975). 
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• SECTION IV 
THE IMPLEMENTATION PHASE 



Objective: 

After finishing this secjion, the program plannef will complete a plan for the 
implementation of a new career awareness program in the area vocational school 
in the case study. 



Purposes: 

• To present descriptions and explanations of implementation procedures 

• To provide simulated applications of implementation procedures 



Background Information 



Implementation of a new product or practice is the most crucial phase of the problem- 
solving process. Unless the implementation is conducted properly, needs assessment and 

successful selection are not as valuable as they should be. * 

* ** * , 

^Effective implementation takes time. It must be well planned and should be based on the 
resutts*of a comprehensive needs identification process, rather than merely on the availability of 
funds. In short, it must be "proactive" rather than "reactive:" 



The major steps in implemention arenas follows: preparation and planning, installation, and 
evaluation of the operation and impact. (For the, purposes of this handbook, evaluation is treated 
independently; in "real" life, the implementationf and evaluation are planned together and become^ 
an action plan for program improvement) 

* * 

. * To repeat, implementation takes time. Movement from initial installation to a fully 
implemented program cannqt.be done overnight, impact on students cannot be expected 
immediately. During this period, you should expect to make program adaptations, both panned 
and unplanned. Do not be disturbed, for this is a natural part of assimilating the new program 
into your system. However, be certain that the critical characteristics of the innovation are not 
lost during installation. These characteristics are closely related to the criteria that were used to 
select the products or practices. V 

* 

Preimplementation Steps 

* When the decision is made to install a new product or practice, the process of change has " 
just^egun. Careful planning is essential. Regardless of the effort to choose the best possible 
product or practice, the innovation will fail if the total school setting has not been prepared 
properly. In other words, the school or school district must be prepared by going through what * 
* Preston (n.d.) refers to as preimplementation steps. • 
\ * 

According to Preston, preimplementation planning includes attempts to resolve potential 
. problems such as'personnel concerns, the fit with the current curriculum, scheduling difficglties, 
find the like. While these difficulties may have been considered during, the selection phase, they 
now must be dealt with in detail. Administrators and staff should be very familiar with the 
innovation and^therefore, be able to approve the next steps in planning. The general impact of 
|he innovation bn the staff should be assessed at this point. Those persons who actually * 
implemenUhe program should be assured that potential problems can be resqlved. 

; , in order to prepare Sot implementation, it is advisable to establish an implementation task 
force at the school or district level. This task force could be the same as the team that has been 
involved, or it could have'representation from the team. The task force will be responsible for - 
developing a detailed action plan. Measurable objectives, a time line for planning and 
implementing activities, and a functioning communications network all will contribute to the 
success of the task force. The preimplementation phase also is the appropriate time to design 
staff development plpns for the introduction of the: new product orpractice. Budget projections 
should be completed as much as possible during this phase; staff assignments should be settled. 
Any necessary staff training; or product adaptation needs to be completed before actual . 
implementation. It also is important to create a pdsitive*climate before the innovation is actually, 
introduced. If a major new program is being implemented, the eritire school— and the 
community— should be introduced to it. 
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Figure 3, adapted from Schriner (1979). could be used to develop a plan fQr gaining support 
for the selected product or practice: *" 



FIGURE 3 

STRATEGY OUTLINE FOR GAINING SUPPORT 



* ( 

Activities 


Responsible 
Persons 


Needed 
Steps • 


Time Line 


Anticipated 
Outcomes 


Obtain support of 
participating teachers 


Site coordinator 


Meet with tejchers 


September 
(first school 
month) 

✓ 


Teachers will 
examine and 
approve products 
and practices. 


Obtain support of 
administrators (prin- 
cipal, superintendent, 
board of education) 


Site coordinator, 
.team members 


Meet with appro- 
priate individuals; 
provide documen- 
tation on the 
products and 
practices 


September 
(first school 
meaih) 


Administrators • 
will examine the 
products and 
practices and "go 
on record" as 
approving. 


Obtain support of 
other groups (e.g., 
PTA, community 
groups, etc.) 


Site coordinator 


Conduct a series 
of meetings 


September and 
October (first ' 
two school 
months) 


Groups will be 
aware of new 
products and 
practices and will 
approve. 

4 



The Implementation Process 

In order to ensure a smooth installation of a product or practice, an action plan must be 
developed. The main elements of the^plan are as follows: * '* . 

• Administration and management: timing, budget, scheduling, facilities, staff assignments, 
and monitoring * 

• > Staff development: ^reinstallation. training and ongoing technical assistance 

• 1 Materials and equipment: ordering, updating, and distribution and use 

* , & 

It is important that roles are clearly defined and that leaders are confident about their' 
responsiblitiesv Materials should be distributed and regular meetings cgnducted, especially 
during the,beglnning weeks. * * ' frV . 

The plan will require continuous review during the entire phase. Actual activities should be 
'compared with specific program objectives arid the program should be monitored at the 
operational level. The budget also will require continuous review. Product modifications may 
require some alterations and this should be taken into account in the evaluation* 
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A positive environment can be maintained through participatory management, flexible 
attitudes on the part of staff, and a systematic communication network. Where the innovation 
directly involves students/ consideration should be given to including their input into program 
assessment and modification. A continuing relationship should be maintained between new and 
existing programs. Preston (n.d.) also emphasizes that persons who will be involved actively in 
the program should feel a sense of ownership. 

The Implementation Plan 

The action plan will take into account many of the considerations of the preimplementation 
stage. The plan should identify the staff members to be contacted (and for what reasons) so that 
the implementation process can begin properly. It also should identify possible problems. The 
task force already will have information on past successes and existing problems. Overall 
agreement should have been reached on the goals. All of these factors should have been 
clarified by tfye'earlier^teps in the,process. Ijrfomnation on goals, needs, and product evaluation 
will expedite the development and execution of the plan. The following items should be 
considered: 

• Program timing and budgeting: time^to prepare for proper implementation; firm dates for 
implementation activities; and budget or steps to seek approval of the budget, if it has not 
been approved 

/' t ■ f» * - — - * » - > 

• Staff assignment, orientation, and training: instructional staff assignments; training 
programs for instructional staff; and orientation for administrators, teachers, parents, 
employers , # 

- • Materials, equipment, and facilities: list of needed materials and equipment; ordering of 
materials and equipment; inventory of materials; arrangements for distribution of materials 
or installation of equipment; necessary facilities reserved and schedules prepared; and 
modifications in existing facilities w « 

• Student scheduling and instructional procedures: scheduling students; notifying students 
and their parents; instructional procedures clearly defined in program descriptions or 
published manuals; mediaJdentified; scope of each activity clearly defined; sequence for 
each activity; and variations in scope and sequence for self-paced instruction * 

The following questions, adapted from Schriner^1979), should prove helpful to program 

^planners: * 

*$. - - - 

Eight Important Questloni to Answer In Your Implementation Plan 

• Whose support is initially rfeeded to gain acceptance of the product or practice? 

• Which teachers- will ; be involved? * «* t 
When should the implementation begin?, „ 

• Why was the product. or practice selected?, " . 



• How much time arid money are involved ifl using the product?. 

• Where will the product or practice be used and what arrangements have to be made?* 

• How will we know if the product is successful and whose responsibility is it to evaluate the 
outcomes? ^ 

• If the outcomes are not those intended, what kind of backup plan is needed?. 



Lastly, the following sample chart for implementation planning could be used— or adapted—, 
as needed: • 



CHART 11 



SAMPLE CHART FOR IMPLEMENTATION 



m 

Improvement 

to be^ 
Implemented 


Major • 
Activities 
Required to 

Implement 

* - — 


\ Person 
Responsible 


Steps 
Needed to 
Implement 


Time 
Line 


Anticipated 
Outcomes 






























* 




























*—r 





>; Case Study Continued 

* & . 

the program improvement tearryyovided the area vocational school board of 
directors with the* result of the needs assessment, the summary needs assessment, 
and the criteria to search for and select a new career awareness program. This 
report was presented by Mr. Phipps, whdfalso shared a summary of the ratings of 
Programs A, B, and C and a brief description df Program A, the one that received 
the highest rating. _ W 

The area vocational school board gave Mr. Phipps approval to purchase and } 
:ijistall Program A^kjring the next school termr Mr. Phipps scheduled a meeting op 
the team to plan fonimplementation. * f 5 

- * > < K\ * * 



fry 
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Learning Experience #4: Implementation Planning 

After yoii have studied the case study and the implementation checklist, complete Activity 



Implementation Checklist 

• Milestone Eight: The implementation plan for the products and practice selected is prepared 
and approved. This milestone requires that a, detailed plan for installation be produced and 
approved. 

Step 1. Determine the content of the plan. 

Major activities 

« 

— Facilities** , 

V 

——Equipment 

Staff requirements - ^ * 

* 1 —Staff training* , # 
^..Staff responsibilities 

♦ 

; Time |jnes 

t 

Costs 

T Step 2. Complete the drafting of the plan. 

/ 

——Write program description. , 
List major activities., 
Complete details Qf the plan 
Write the actual plan. . ^ j *p - 

Select a director for implementation 
Complete implementation cljart. 

Major tasks 
——Person assigned to each task v * 
Target dates f: 



, Step 3. Submit plan to the school board. 

„, Step 4. Negotiate terms of funding. 

Step 5. Secure approval. 

Activity #6: Development of en implementation pten. Using the description of Program A and 
the items to be considered in planning for implementation,. complete the following planning chart 
for Program A. As before, some activities have been filled in to get you started. Check your 
responses with the suggested answer sheet. Complete Activity #6. 

(Note: As in all of the handbook exercises, in "rear' life, the plan would include more detail 
and an extensive activity list. For example, a partial plan for implementing a reading program^* 
developed by an actual school team is found in the supplementary resources. Also, as indicated, 
an evaluation plan is part of an implementation plan. While the final section of the handbook 
presents evaluation planning as a separate activity, in reality, it is part of the planning for 
installation.) ^ 



• CHART 12 
IMPLEMENTATION PLANNING CHART 



Activity 


Dates 


Staff 
i - Resoonsibilitv 


Materials/Facilities 
Additional Pftrsonnal 


& VW9l 


. t 

•Preparation for install- 
ing Carler Awa reness 
Program 

1.. Order materials 


3/1 to 9/1 

> 

- * 

3/15 


Mr. Phipps and the 
area vocational 
school team 


Total Program A set of M 
materials for all particW 
pating staff 




r • 

2. Correlate with 
current program * 


3/1 to 5/1 


Mr.. Phipps, the team, 
curriculum coordi- 
nator, and counselor 


Current materials and 

Program A materials 
* 




.3. Initiate public 
relations releajjps 
on Program A 

4. . / . . 


8/1 to 8/30 


Area vocational 
school administrator 


Paper for copies 

0 

♦ 


% 


5. 




4 

t 

\ 


• 


T 


•Installation of Pro- 
gram A 




1 






1.. Orientation 
• 

2, Begin use of 
Program A 

, 3 - : 


9/10 

i i 

10/1 


Mr. Phipps and 
curriculum cpordir $> 
nators * ) 

Teachers, ^ 
cotinselors 






•Evaluation of . , 
Program ^ '(See | f . 
Evaluation Plan) 


\ 

3/15 through 
6/1 of follow? 
ingyear 






• 

i 



CHART 13 - • 

IMPLEMENTATION PLANNING CHART: SUGGESTED ANSWER SHEET 



Activity 


Dates 


• Staff 
Responsibility ^> 


1 Materials/Facilities 
Additional Personnel 


Cost 


•Preparation for install- 
Career Awareness Pro- 
gram A 


3/1 to 9/1 


Mr. Phipps and the 
area vocational 
school team 


Total Program A set 
of materials for all 
participating staff 


$20,000 


1. Order materials 


3/15 








2. Correlate with 
current program 


3/1 to 5/1 


Mr. Phipps, the 
team, curriculum 
coordinator, and 
counselor 


Current materials and 
Program A materials 




s 3. Initiate public - > 
relations releases 
on Program A ~ 


8/1 to 8/30 


Area vocational 
school adminis- 
trators 


Paper for copies 


— 


4. Area vocational 
school and feeder 
school inservice 
on Program A 


8/1 5 to 8/20 


Mr. P.hipps 


Consultant from Pro- 
gram A, workshop 
materials 




5. integrate Program 
A into student 
schedules'at , 
feeder school 
and area voca- 
tional schools 


7/1 5 to 8/1 5 


Curriculum 
coordinators 
and school 
administrators * 


* 




6. Distribute mate- 
rials to schools 


8/1 5 to 8/30 


Curriculum 
Coordinators 






• Installation of Program A 










1. Orientation for 
students, parents, 
* employers 


9/10 


Mr. Phipps and 
• curriculum 
coordinators 


Handout materials,' i 
pressreleases 1 


$150 : 


2. Begin use of 
Program A 


10/1 


Teachers,' 
counselors* 


i 


— 


3. Monitor use 
Program A 


10A1 to 6/1 

*/ 


The team, Mr. PJiipps, 
aqd cuiriculum ' 
coord ihators- 




t 


4.- Provide ongoing 
technical assistance 
• to staff 


10/1 to 6/1 


Mr. Phipps; 
curriculum 


Program A materials, 
Program A consultants 


$4,200 


• Evaluation of Program 
A (See Evaluation 
Plan) 


3/1 ET . ' 
through 6/1 
of following' 
year 


< * 


m 

\ 





FIGURE4 
A SAMPLE PLANNING WORKSHEET 



ft 

a 










* 


.Major activities 
required to 
obtain support for 
implementation 


Person 
respon- * 
sible 


Steps needed 
to implement 
product/program 


; 'i 

Time 
line 

<By:K ' 


Anticipated 
outcomes 


• 

* • 
Evaluation* 
methods 


Obtain support and 
.approval of partici- 
pating teachers. 


Site coordinator 


Meet with 
teachers. 


Sept. 


Teacheits will 
, examine and 
approve! * 


Official approval . 
on file. , 

* 


Obtain support and 
approval of adminis- 
tration (principal, » 
superintendent* 
board of education, 
etc.). 


Site coordinator, 
team members 

•> 


Meet with appro- 
priate individuals, 
provide documen- 
tation and ration- 
ale. 


.Sept. % 


' Individuals will 
go on record and 
approve. \ 


Correspondence 
on lile. 


Obtain support of 
- other groups or 
individuals (e.g. PTA, 
community groups, 
etc.). 


Site coordinator 


Series of 
meeting's. 


Sept. * 
Oct. 


Groups willlkoDW^ 
of new materials 
to be used and 
approve. * \ 


Meeting notes 
and/or official - 
approval on file. 


* Identify role each 
participating teacher 
will plan in imple- 
mentation. 



Site coordinator, 
team members 

> 


Series of 
meetings. 

„ \ 


% 


Teachers will \ 
become familiar 
with materials. 


Meeting notes 
and«outcomes 
on file. 
m< 


Coordinate and 
inform all faculty of * 
implementation 
activities. 


. Site coordirtator, 
team members 


Meet with 
teachers; inforffi 
via newsletter, 
etc, * ^ 




All faculty will 
be familiar witft 
materials. I 


.None required . " 

0 


Provide for on-going 
use of the materials 
after initial imple- 
mentation. 


Site coordinator, 
team members, 
other interested 
teachers 


Meet with team 
members and 
other interested 
teachers. 




Participants win 
justify further/ 
implementatipn 
or rationale for 
dropping materials. 


Materials evalu- . 
ated by commer- 
cial test or other 
evaluation 
method. * 



SOURCE: JaniesD, Schm^x t Problem-Solving Workshops: A Trainer's Guide. Lansing, Ml: Michigan Department of 
Education, J980, p. 58, t . < ' 
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Supplementary Resources 

■ 

Additional Printed Sdurces 

For additional information on Both implementation and evaluation planning, you may wish to 
study several pamphlets developed for the GeorgiaTDepartment of Education. "ImpJementation 
* Checklist of Steps" (Preston n.d.) is afi easy-to-use*checklist that can be used or adapted to a 
local setting; jt covers steps in the preimplementation and implementatioa planning stages. Two* 
other items, available through the Georgia Department of Education,* also are valuable, i.e., an 
Evaluation Bibliography (1979) provides abstracts on publications in the area! of evaluation of, 
* e innovative practices, checklists, formative or process evaluation, general evaluation issues, and 
methodological issues; and an Evaluation Checklist (1979) provides a step-by-step guide to 
evaluation that covers goals and 'objectives, assessment instruments, data requirements, data 
s 9 collection and analysis, monitoring, and reporting. 

In addition, the segond«volume of the Pennsylvania Department of Education's Pennsylvania 
School Improvement Program: Thd Linker's Handbook for Curriculum ImprQvement Strategies 
• (1978) has many guidelines and samples of implementation and evaluation planning. 

* * Twenty-eight Techniques for Implementing Innovations are listed and discussed jn theappendix. 

Figures 4 and 5 below also are valuable planning tools. 





V r " FIGURE 5 

A SAMPLE IMPLEMENTATION PLANNING CHART IN THE READING AREA 



Activity 



n 

2.* Installation of manage- 
ment system 



2.1 Staff training in 

. use of r * 

a. Skills list 

b. Criterion Refer- 
enced Tests 
(CRTs) 

c. Student record- 
* keeping system 

2.2 Begin use of system 
in classrooms K-4 
for 1979-80 
school term 

a. Distribute skills 
list, CRTs, stu- 
dent record 
forms 

b. Monitor use of 
system 

2.3 Assess effectiveness 
of system \ 

a. Teacher logs 

b. Interviews 

c. Evaluation forms 



Staff 
Responsibility 



Materials/ 
Facilities 
Additional 
Personnel 



Person Days 



Possible 
Constraints/ 
Problems 



2 A Revise system 



Local Action Team 
(LAT), reading 
coordinator, and 
principal 

Reading coordina- 
tor and LAT v 



2.1 



Reading coordina- 
tor and total 
staff ' 



2.2 



Printed 
copies of 
CRTs, 
skills list, 
student 
record 
forms, dup- 
licating 
service 

CRTS,, 
skills list, 
checklist, 
\student 
rebord form 
for all class- 
rooms, dup- 
licating 
service 



2.1 Staff- 
forty days 



2.2 



Reading coordi- 
nator, LAT and 
principal 



2,3 



Copies of 
teacher 
reporting 
forms, 
\ evatfuation^ 
forms,' 
secrei 

help/ paper 
and piate- 
rials 



Reading coordi- 
nator, LAT and 
principal 



Total 
school 
term— total 
staff-180 
days per 
person 



2.3 Staff-ten 
days 

retary-i- 
ive days 




2,4 Staff- 
ten days 

Secretary- 
five days . 



2.1 



2.3 



Staff assist- 
ance for 
work in- 
volved 



2.2 



Maintaining 
use without 
upsetting 
staff with 
new pro- 
cedures 



Collecting 
data without 
overburden-, 
ing staff 



2.4 Revise 

without 
^increasing 

staff 
responsibility 



SOURCE: Adaptec!" from Pennsylvania Schooljmprovement Program, Working Papers (Harrisburg, PA: 
Pennsylvania Department of Education, 1978). , • rtV «' 
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SECTION V 
THE EVALUATION PHASE 



Objective: * 

After finishing this section, the program planner will complete an evaluation 
plan fo assess the effectiveness of the new career awareness program 
implemented in the area vocational schopl in the case study. 



Purposes: 

• To present descriptions and explanations of evaluation procedures 

• To provide simulated applications of evaluation procedures- 



4 - 




Background Information , 

, •* 

' Evaluation is an indispensible part of the program improvements process. It is the one | 
source of informatiohithat supports the decision. to continue,jnodify, or discontinue a program. * 
Evaluation findings canTjustify the levels of effort that have been invested, since these data can 
document improvement in areas of need that initially triggered the process. It is the only way to 
answer the two important accountability, questions: What payoff did we get from our investment? 
How do we know the payoff was caused by the investment?^ 

Figure 6 illustrates the major steps in program evaluation. 

I ' 

Evaluation Planning 

♦ Evaluation, shoulS.be conducted on both the process of program implementation activities 
and the outcomes, that is, the observed impact on students, teachers, and administrators. An 
outline of the major steps; in evaluation is illustrate^ in figure 6. While formative evaluation 
focuses on what is happening in the program^summative evaluation focuses on outcomes. In the 
former, evaluators ask whether the program is doing what was expected and whether thgse 
involved are actually following the implementation plan. If discrepancies are found between the 
implementation plan and actual practice, the staff must make necessary modifications in one or 
the other. 

A variety of instruments may. be used to gather formative evaluation evidence. 
Questionnaires, direct observations, checklists, teacher logs, school records, and interviews all 
are appropriate for gathering such information. The standard of cpmparison for implementation 
must be established in advance of the data collection. (For example, it is. important to determine 
the number of students to complete a certain number of lessons each week, or to determine how 
maiw teachers use a product X percent of the time, etc.) Instruments to assess these elements ^ 
mpsVbe, developed or located. In some cases, .the product will include evaluation 
instrumentation. An evaluation team should be identified to take responsiblify for these activities. 
These individuals, should maintain the schedule, summarize and report information, and revise 
the evaluation plan as necessary. In addition, it is important to clarify in advance who will receive 
the evaluation report anrfwhat kind- of decisions will be based on it. 

Summative evaluation, on the other hand, weighs expected outcomes against observed 
outcomes. Its primary concern is whether the program has a positive impact on students. In this 
type of evaluation,, more complex evaluation methods are used. The primary question to be 
answered is how much the students (or teachers, etc.) have improved as a result of using the ■ 
product or practice. The following are important steps to remember when conducting this type of 
evaluation: select an appropriate design; identify the cognitive and/or affective outcomes; identify 
the instruments needed for^e&ch outcome; set standards for comparison and identify the source 
of baseline data; identify who will take the test and when; decide the use to be made of data; 
decide howjhe data Will be analyzed; and .decide what will be included in tfie- summative 
evaluation report. . , ' 

In many cases, school personnel may be implementing an innovation that does not relate to 
student .achievement. The innovation may involve administrative practices, teacher inservice, or 
an activity outside the classroom. In such cases, national norms may not be available, although 
desired standards may.be^set. At timeSr information from' questionnaires, Jogs, and interviews 
provides sufficient data to determine thelsuccess or failure of a productor practice. * 



FIGURE 6 , . 
MAJOR STEPS IN PROGRAM EVALUATION 



Resources 



Activities 
s Stepl 



Evaluation Questions 



Program Description 
Context - Objectives - Procedures 



Literature, Experts^rofessional' Staff, 
Commercial Materials, Curriculum Guides 



A 

Step 2 



What is the program supposed to be like? 



Assessment of a Functioning Program 

Use the product of step 1 - 
objectives anddescriptors 



Classroom Processes, Facilities, Student 
Pr6gress, Staff Patterns 



A 



F 
0 
R 
M 
A 
T 
I 

V 
E 



Is the program functioning as it is 
described? 

Collect data: records, interviews, checklists, 
tests, observations, unobtrusive. measures 

Decision: modify if there are discrepancies. 



V 

Step 3 



Assessment of Program's I fnpact 



Norm-referenced Mastefry, Criterion- # 
referenced and/or Affective/Cognitive 
Data , 



Is. there a discrepancy between outcomes in 
step.1 and actual student impact? 

Can a relationship be established among the 
implemertjation descriptidhs (from step 2) 
and the outcomes? * 

• Decisions: terminate and replace; revise 4 or 
& ' legitimize \ # * _ 

SOURCE: Adapted from Pennsylvania Department of Education, Pennsylvania School Improvement Program:' The 
Linker's Handbook for Curriculum Improvement Strategies (Harrisburg, PA: Pennsylvania Department of Education,^ 
1978K » ' ,m*< V 
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It should be noted that many times formative and surhmative evaluations are assessing the 
same targets— but for different purposes. There are several generic questions that should.be 
asked when plannirjg bothjypes of evaluation t -for example: 

• What elements da we need to evaluate? 

• * What questions need to t>e answered regarding pach element? 

• How can-we coWect data to answer these questions? ^ ( 

• What will our* standard of comparison be for each question? > 

• Who will be responsible for evaluation? 

• What will we do with the information? 

• WherTwill each evaluation activity take place? 

In addition, a number of evaluation questions specifically relate to each type of evaluation;^ 
Specific questions dealing with formative evaluation are as follows: ' 

• Wha^questions should be asked? . . 
V What critical elements should be evaluated? 

• How should we evaluate the critical elements of program implementation? 
1 • Who should be responsible for evaluation procedures? 

• What kinds of decisions will be made on tjje basis of our evaluation? 

• What kinds of specific data will we need Xq make these decisions? {e.g., data on staff 
. * training, quality of program activities) 

• What instruments are available to obtain arid to record the data needed? 

• Does the program have procedures built into it that can be used to collect the information? 

• Will we find it necessary to construct our own instruments? 
/Specific questions dealing, with summative evaluation are as follows." 

• When shall we evaluate this? ' \ . 

• • • 

• How shall we evaluate impact? What kinds of data do we have on hand? What data will we- 
•Have to collect? " % 

• Who will be responsible for evaluating impact? 

• What instruments are available? Where can we acquire the necessary instruments? 



Evaluation Instruments 



; - .Obviously, some type of evaluation instrument will be needed— whether you' are planning for, 
Joroative or summative evaluation. Figure 7 summarizes the various types of 'instruments that 
could' be used. 

« • 

When the decision has been made regarding the type of instruments to be used, the next 
step is to find or construct an instrument, if you are seekingTcommercially available instruments, 
the following questions should be considered: 

<» 

• Do the items assess the critical elements you are interested in? 

• How costly are the instruments? . m b 

• Are the instruments valid and reliable? (Do the tests do what they are intended to do? Do 
they yield consistently accurate results oyer time?) r • 

< • •* 

• Are the instruments easy to use? ' 

• Are the instruments suitable for the type of person who will be responding to them? 
Several questions for constructing program-specific instruments are as follows: 

• What is each program element intended to accomplish? 

• How is each element intended to accomplish the pfanning outcomes? 

• Several steps in constructing instruments should be considered: 

* » 

• Decide what type of instrument is, needed, e.g., questionnaire, checklist, interview schedule, . 
log^ating 'Sheet, and/or open-ended narrative. \ 

• Decide on type of items, e.g., open-ended, c^sed response, or a combination. 

• Write items that relate to the information you need to gather for each activity (i.e.^at least 
one instrument for each 'major activity). Be sure directions are clear. Have several persons 
answer the questionnaire and critique it. 

- .a 

• Critique, analyze, and try out the items. Submit them to others for reactions and revisions. 
Have seyeral people try out the instrument again and critique it. 

• Produce the final version. 

4 • Administer instruments as scheduled in the evaluation plan. " fr-^^~V-,;- - 

Tht Evaluation Rtport V # f 

Reports of evaluation findings should'be provided to the program direotop4nd other decision ! 
makers as early as possible so that the results can be used for program decisions. Do not wait 
until alt of the evaluation activities are completed. Provide ongoing; interim summaries as each 
set of data is analyzed. Several important suggestions for the content outline of either an interim 
.or 'final Evaluation report are suggested below; — ~ t mtS J,. 

. ■ "• ' 74 - 
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FIGURE 7 • 
TYPES OF EVALUATION INSTRUMENTS ' ! 



Type of Instrument 


For Measuring 


Type of Items 


*• 

* 

Scores 


oianaaruizea norm- - * 
referenced tests 


Student achieve- 
ment 


Multiple choices 
True/false_ 

■ ( 


• * 

Grade level, percentiles, 
sjanines, raw scores 

• 


Criterion-referenced ♦ 
tests i 

(Commercial or self- 
constructed objective 
references) ' 

Product analysis 


Student achieve- 
ment 


■ w 

Multiple choice 
Essay, open-ended 


Number right, percentage 
right, categories of . 
responses 

• — 

*K *J 


Checklists 

Observation scales, 
anecdotal records 

Self-reports 

Questionnaires 


A 

Student attitudes 
and behaviors* 


Yes/no ' 

Rating scale 

(1-5, 1-7, 1-9, etc-) 

Open-ended 


Number of positive 
responses or percentages 

Number of negative 
responses or percentage? 

Average score 


Self-reports 

Teacher logs * j 
Observation schedmes 
Questionnaires 


— 

(Program events 

/ 

Instructional . 
practices 

Teacher behavior 
* 

Teacher attitudes 


Open-ended, multiple 
choice 

Yes/no* 

Tally/count of . 
events 

Rating scale 

(1-5, 1-7, 1-9, etc.) 


Raw scores, total count 
of positive or expected 
, events or behaviors; 
^categorization of responses, 
T^t^gguntsof negative 
events 



SOURCE: Maptedjrom Pennsylvania Department of Education, Pennsylvania School Improvement Program: The 
"iMker's Hhricfa vol. II. (Harrisburg, PA: Pennsylvania Department of 

Education 1978). * *. 



• State the purpose of the evaluation and the questions to be answered. 

• Describe the program* 

» » * 

• Describe the students and the school. 

• For each question In the evaluation design, telMiow data were collected. Summarize the 
ddta, showing distribution of scores, average scored, or the proportion of students meeting 

^ a specified level of achievement. , 

* 

• Discuss tjjsjgesults and clearly state the answers to each question. 

• Make recommendations based on the results. 

An evaluation report can be-very lengthy and can provide all the data analyses and results; 
or 'it can be a brief narrative summation with data analyses available for review. Usually a brief 
summary is sufficient. * / 



Case Study Continued 

The team met with Mr. Phipps to complete the final stage of the process, 
namely, developing an evaluation plan for career awareness Program A. Mr v 
Phipps provided N them with the completed implementation chart and the various 
evaluation planning questions. The team was ready to complete the evaluation 
plan for Program A. 



Learning Experience #5: Evaluation Planning 

# 

After you have read the evaluation checklist and the continuation of the case study, 
complete Activity #7. 



Evaluation Checklist 



4WK 



Milestone Ninp: The evaluation desiijn ys Qompletedjn order to assess the effectiveness of 
the products and practices selected. This milestone requires designing and planning for 
evaluation and assessment of Tfie irtfpact on students. < - Ztf*'- 

\ I t * » i . » ': 
\ j 1 / - v 

Step 1. Identify the major program fcomponentS to be evaluated. x 



7 \ » 

.Materials / vi 



.ProcecTuresVnd activities 



Facilities • j 

_Staff performance % 



.Administration and management 



Goals Igf 

Students performance 

Scheduling 

——Staff training 

Costs ,.i 

stftp 2. Design the evaluation. 

Specify questions for each major implementation activity. 

^ Identify techniques to be used for each question. 

* 

Identify respondents. 

I .Determine appropriate statistical analyses for each question. 

—Select or construct instruments. 

Set dates for each data collection. 

Milestone t&n; Products and practices are installed. This milestone requires that the 
implementation plan be followed in order to install the products pr practices. 

Milestone Eleven: Products and practices are evaluated. This milestone requires timely data 
collection, analysis, and reporting. 

I " 4 

Step 1. Collect and analyze data. 

I rTrain staff in data collection. - \ 

Distribute testing materials. 

* Collect data. 1 

Prepare data for analyses. * f *' 

.Summarize data for eacp progratn or activity. ^ J 

, ' Conduct analyses. 

—Complete analyses of data summaries. » 
Prepare tables and charts. <^ . 



—Compare desired program outcomes with evaluation 1 conclusions^ 

.Compare student antf/or program status .with baseline data from needs 

assessment. , Ja * h ' 



Step 2, Prepare the evaluation report. 

-identify audiences. 

Determine appropriate formats. 

Complete initial draft: 

Review *tJfaft and revise. ' I 

, % Disseminate to appropriate audiences. 

Milestone Twelve: Further program management decisions are made. This milestone 
asscmies that the primary purpose of evaluation is to provide information for decisiorf making. 

Step 1. Program decisions are made on basis of evaluation. 

Make formative evaluation decisions: continue and expand; revise and 

adapt. . 

Make summative evaluation decisions: terminate; search for a 

replacement; return to former program. 

Learning Activities 

4 Activity #7: Developing a formative evaluation plan. Using the evaluation planning questions 
and the implementation answer sheet, complete the evaluation plan for Program A in Ghart 14. 
Use the suggestions below to complete the chart. Check your responses with the suggested 
answer sheet. Complete Activity #7. + 

» 

The following points should be considered when completing the evaluation chart: 
i 

• What is to be evaluated? This first 'column in the chart is completed by selecting critical * 
elements from the implementation plan. 

• Questions that must be answered about each element are included in column 2. 

• How the information will be cpllected is inserted in column 3 V e.g., 

— Questionnaires— Who will respond? Will the questionnaire concern attitudes, pr6"grams, 
or both? (All items should^ reflect activities and procedures specified in the program 
plan.) . r ^ ' ^ ""' 

— Observation's— Who will be observed? Who will observe? 

— Checklists— Who will? respond? (Items shouldjreflect program objectives.) 
—Teacher logs— (Items should reflect critical student and teacher activities.) 




.' — Interviews— Who will be interviewed? Who will conduct the interviews? 
• How the data Will be analyzed and reported is inserted in column 4: 
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CHART 14 
EVALUATION PLANNING CHART 



1 

Description of 
Program Activity 


2 

Evaluation 
Questions 


3 

Type of 
Evidence 


4 

Analysis ' 


i 
i . 


rreparaiion Tor 




» 












inctaiiinn rarppr av/t/arp. 
II lolai in i y irfdl CCI aWalC" 








* 








ness Program A. 
















1.1 v 0rder materials 


1.1 




1.1 


\ 


1.1 






1.2 Correlate current 


1.2 


• 

Were the mate- - 


1.2 


Analysis of 


1.2 


Summary of staff 




nronram with 
fji uy i ai 1 1 wi in 




mq1c /^nrrolotorJ 




cornpieieu 




responses on 




Prnnram A 
riuyiaiii / 




wiin curreni 




**inveniory ot 




cnecKiisi xo evalu- 


■ 






career awareness 




current materials 




ate the inventory 








pruyrdrnr 




Keyed xo program 














r\ Uy If Ic bid 1 1 
















using checklists 




S 


1 ? 


Initiate miKhis* ralatinrtc 
lllllldlc (JUUlIti luldllUMb 


1 .3 


• 


1 


j 




r 




releases on Program A 




m 










1.4 


Area vocational school > 


1.4 




1.4 




1.4 






and feeder school 
















jnservice 














1.5 




1.5 




1.5 




1.5 


* 


1.6 




1.6 




1.6 




1.6 




2. 


Installation of 








\ 








Program A.< 










I 






















2,1 Orientation for 


2.1 




2.1 




2.1 






students, parents, 
















employers 








* 't 








4 

2.2 Begin use of 


2.2 


• 


2.2 




2.2 






Program A 








** 























CHART 15 

* 

EVALUATION PLANNING CHART: SUGGESTED ANSWER SHEET 



• • 1 

i 

j Description of 
Program A ctivit y 



Evaluation 
Questioni 



Type of 
Evidence 



Data 
Analysis 



1. Preparation for installing career 
awartness Program A # 

1 » ' . 9 

1,1 Order materials 



1.2 Correlate current program 
with Program A 



1.3 Initiate public relations 
releases on Program A 



1.4 Area vocational school and 
feeder school inservice 



3.5 Integrate Program A into 
student schedules at feeder 
school and-area vocational 
schools 



1.6 Distribute materials to 
s schools 



2. Installation of Program A 

2.1 Orientation for students, 
parents, employers 



1.1 Were the materials 
ordered and 
deceived by 
target date? 

1.2 Were the materials 
correlated with 
current career 
^awareness program? 



1.3 How accurate were 
the releases? Were 
they released at 
appropriate time? 

1.4 Did the staff attend 
the inservice? Did 
they meet-thelr 
objectives?/'; 

1.5 Was Program A 
integrated into on* 
going instructional 
program for stu- 
dents? 

1.6 Were Program A 
materials accessible 
io each participat- 
ing staff person? 



2.1 Were orientation 
sessions held? How 
effective were they? 
Who attended? 



1.1 Monitoring of 
activity by area 
vocational school 

4 director 

1.2 Analysis of com- 
pleted inventory of 
current materials 
keyed to Program 
A by the staff, 
using checklists 

1.3 Review of releases 
by the team 



1.4 Review of roster of 
participant ques* 
tionnaires and inter- 
views constructed 
by the team 

1.5" Review program 
schedules of 
schools 



1.6 Checklist inventory 
of materials deliv- 
ered to participating 
staff 



2.1 Team conducted 
• evaluation form for 
participants' records 
of attendance 



1.1 Summary report of 
materials inventoried 



1.2 Summary\ of staff ' . 
responses qn check- 
list to evaluate the 
inventory 



1.3 Summary report of 
team review 



1.4 Summary report of 
pre/post workshop 
questionnaires show* 

* ing Changes jn attitudes 
and Knowledge 

1.5 Summary ofthe rate 
of expected use with 
students 



1.6 Report of number of 
incomplete sets of » 
materials, undelivered 
sets, materials sent to 
, wrong site, etc. 



2.1 Item analyses of 
. participant'evaluation 
forms, categories, and 
number of participants 



CHART 15 -Continued 



1 


2 


* . 3 


"4 


Description of 
Program Activity 


Evaluation 
Questions 


Type of 
Evidence- 


Data 
Analysis 


2.2 Begin use of Program A 
* 


2.2 How frequently 
and consistently 
were Progra^n A 
materials used? Was 
Program A properly 
utilized? 


2.2 Teacher and student 
logs constructed by 
teamf interviews 

, ; and questionnaires 
provided as part of 


2.5 Summary data from 
teacher and student 
logs; item analyses of 
questionnaires and ' 
interviews <* 


\ 2.3 Evaluate Program A 
V 


2.3 Were all of the 

questions addressed? 
Did data collection 
and analysis occur? 
Were reports pro- 
duced in time for 
decisions? 


2.3 Monitoring of the 
evaluation activities 
by the team 


' © ' 

2.3 Not applicable ^ 



c 



Final Note 

m * 

You have completed a formative evaluation plan for Program A. While the summative^ * 
evaluation plan would use the same procedures, the focus would be on such outcomes as impact 
on students, staff, course enrollment, employment patterns, and the like. 

You alsQ have completed the critical steps in the program improvement process and now. 
have acpess to the major content of a plan for career awareness in the area vocational school 
and the documentation of its validity. Witlvthe addition of a narrative introductory explanation , 
arid a line-item budgetjheplan is complete. . ^ 



'• • . . . \. . . • - 

. Supplementary Resources 

Evaluation handbooks. The following two resources are valuable for assessment activities: 
Franchak*and Spirer (1978) included specific techniques,, legislation requirements, development 
of forms and instruments, guides for interpreting data, and alternatives for reporting. Franqhak 
and Spirer (197b) also developed a handbook that examined context, definitions, and strategies; 
they identified current problems and Issues along with existing practices that have proven to be 
successful. 

■ r 

Additional resources. Three other .items, available through, the Georgia Department of 
Education, also are valuable. (Two of these sources were cited in the implementaj/oh.section but, 
\ becduse of their relevance, should be repeated here.) The three items are as follows: * 

~ * * * 

• Evaluation Bibliography (1979)— This annotated bibliography is intended to provide selected 
references* that complement the Evaluation Checklist, Evaluation Guide,' and other materials. 
The- bibliography does not purport to be exhaustive but, rather, serves to suggest alternative 
resources. Included in this dotument'are entries under the following headings: evaluation of 
innovative practices, checklists, formative or process evaluation, general evaluation issues, 
andTnethc^ological issues. ■ 

• Eyatu&tion Ohecktist (1979)— This forty-five item checklist is a step-by-step guide to 
evaluation fyat includes sections on purposes, goals and objectives, assessment 
instruments, data requirements, data collection, data analysis, monitoring, and reporting. 

• Evaluation Guide (1979)— Thepurpose oi-the guide is to explain and describe each task 
listed in the Evaluation Checklist.. References for additional help in planning and conducting 
an evaluation are listed in the Evaluation Bibliography. - 

— * 

In addition, tbe following useful documents are listed in the additional readings section of 
the references: Adams *nd "Walker (1979), Easom'et al. (1978), Nickens, Purga,*Noriega (1980), 
and Wentling (1980). . 



SECTION Vf 
^ SUMMARY * 

Thi$ handbook is not so lengthy that it requires an elaborate summary* of the four problem- 
solving phases for program improvement, or the twelve milestones, or, for that matter, of any of 
the detailed lists* of questions and guidelines. There are, however, two possible exceptions where 
there is a need to highlight a point We do need to go back and underscore two fundamental 
milestones: Milestone One stressed that the priorities and goals of the school district be 
identified or, if they are not present, that they be developed. Milestone TWo stressed that the 
school district commit itself to participate in the program improvement process.' Without the&e 
essentials, the process is merely a useless notion that goes nowhere or is busy work, as we 
termed it. ^ 

The second point that bears repeating i& the idea that this handbook is a tool, a vehicle that 
is intended to provide the user with information and suggestions to apply to the (Program ;' 
improvement process in an actual school setting. The milestones and the related steps are 
^adapted from field-tested projects.' They are intended to be a' gliide to the program planner. A 
* review and adaptation of them in yaur local planning situation would serve as a useful tool to 
guide the program implrdvement process. 

For a convenient review the twelve milestones and related checklist have been assembled as 
part of this summary on the following page. # 

* * * 

We hav^attempted to be as concise, yet as comprehensive, as possible; We trust you will,'* 

find the handbook helpful in your wprk. v /• ^ / 



Twelve Milestones 

• » 
PRELIMINARY ACTIVITIES ' , 

1. The* priorities and goals of the school district are identified and/or developed. 

. 2/ The school district commits itself to participate in the'process. 

(Note: All of the school-level milestones below relate \0 the priority areas identified at tfte 
district level.) M * 

. NEEDS ASSESSMENT * . 1 ' 

3. Target area of need is idehtified5(This^milestone is based on the notion that successful 
program* improvernpnt nr^ust focus on 'clearly defined^ problems.) 

! Step 1. The existing school date' in priority areas are gathered. 

' Step 2. t Data are summarized and analyzed. 

\ * « • * 

• • Step 3. The schooLprofile is prepared, including all available background data. 

Step 4. the first needs a*sse^rpent Meeting of the team is 'conducted. 

^.School <^ata summaries and profiles are reviewed. 

y Team reacts to 

__Step5. - Tfefg&neral needs statement is prepared. This will define the school 
>^1arget area to.be improved. - \ 

4. Specific in-depth needs ar& identified in the target area. (This milestone is achieved through 
a comprehensive analysis of the current status efforts in the target aree, in order to identify 
specific needs that aVe causing.problems.) \ * ^ \ 

• - i, fttep f. Program materials are analyzed. 

K * * • * 

—Interest levels ■ 

*^'\ - \ * : Variety . ^ - * 

. — Compatability with area vocational school goals in the target area 

/ . _\ -^Availability 1 . U ' 

* . -Quality (Is it up to- date? Is it comprehensive? Are the reading 

levels appropriate?). ^ * V ;v \ 

• ' • . * * * " ' ' • 

, Step 2. r Major elements In the target area are analyzed, usfng questionnaffes; 

. • ; \ ' -* ^ Interviews, and Observations." >^ 



Administration and management t 

' ' * / 

* Staff development f . 

Student services ' - * . % ' 

» '* * * ""^f." 

» * r 

instructional program •: • .-. 

- Step 3. Data from Steps 1 and 2 are analyzed and summarized. , V: * # * - 

5. Aidetailed needs summary is prepared for the target problem area. (This milestone tey^y 



achieved by reviewing all the data produced in both Needs Assessment Levels On^artd* *■ v > 

— $tep1. The needs assessment summary is p^^red. . ^ \ 

Review alt previously summarized materials. - V V. 

^ ——Review dW summaries-on administration -and f/ianadement; staff' " # r V 

\ * ' development, student services, and instructional pjo^raml * % 

* ; Review the general needs statement from-Level-One. / ^~r r ♦ ; 

- Prepare a summary chart for thej^rget area; ^ ^ „ 7 V 



Step 2.- The total area vocational schopl staff reactSr^nd accepts thersbmmary ; 
chart. •* . - - - r ^'„ ;V • " --v - : -j" 



.Reach a consensus on neepls to address irrtlje search *an.d , 
selection process. - . ^ /, '* 




SEARCH AND SELECTION , - : ' : ^Z^T r; CV V 

6. Alternative jjrodutts* ana practices are identtfie^(^ 

schoof needs identified i/^ milestone-five ^witfi ^^&t^^gv^I^^^f5^ii ct$ $nd practices.)' 



■\ 




7. Products* . , _ — ... - . . . rV/< 

screening.ariif evii^^ ^41^fatfv^.roAig^ fiC^B^racti^j^lf^ cyrtf^KtojttQ^ # 




j Step 1. Review the products. • ^ 

t * 

—-.Screen the set using the selection criteria. 

-Eliminate all but three or four products. 

g*>p 2. Select the product "or practices. 

Consider the total staff rating of the products. 

_ ^—.Prepare the summary of ratings. 

. Select the products (or practices) to be installed. 

' pr alternative Step 2. if all the products. are rejected, begin a curriculum 
development prootfSs, a development process for management activities, 
and similar activities as needed. 0 

Identify the .process. 

i DeVfefop a plan to implement the process. 

Initiate the process. ' 



IMPLEMENTATION, / 

■ . 
8. The'implemerifation plan for the products and practice selected is Spared and approved, 
(this milestone requires ^atfjtdetdi(ed pJan for installation be produced and approved.) 

- gfc»p 1. f^terinlne thfe content of the plan. 

v'l^^Ktejdr activities ■ . r & 

*\ - - ^^Facil\ties ^ \ / 



♦ - 'A ii^E^iiipraent 

^Staff requirements . 



. V: ■ 



-Staff training 
-Staff responsibilities 



V " «^_Time lines 



i^StepS. Cpmpjete thej drafting of the plan. v : - if}: 



.List major activities. . 
.Complete details of the plan. 



Write the actual plan. 

Select a director for impfementation. 

Complete implementatfon chart. 

Major tasks ff ) 

i Person assigned to each task 

Target dates 

* ' * Cost 

■ .Step 3. Submit plan to the school* board. 

i Step 4. Negotiate terms of funding. 

, H_ Step 5,. Secure approval/ < • 

EVALUATION • • 

9. The* evaluation design is completed in order to assess ttfe effectiveness of the products and 
practices selected 1 . (This milestone requires designing and planning for evaluation and 
assessment of the impact on students.) t 

Step'1. Identify the major progran* components to be evaluated. 

Materials \ - 

• - - * ~ ri-. ' 

Procedures and activities 

(i— — Facilities ^ • \ 

7 1 / 4te 



(\'\ ^ Staff performance' 

\__Admihistration and management 
Goals . 

^Students performance / • , 

—Scheduling ** , ; . ' # \,\ 
1— Staff training * * / 
Costs' X t 



\ « 



1 



Step 2. Dejign the evaluation. 

• * 

* Specify questions for each major implementation activity. 

.Identify techniques to be usfed for each question. 

* ——.Identify respondents. 

—Determine appropriate statistical analyses for each question, 
. —.Select or construct instruments. 

. - - . / 

Set dates for eacjh data collection. / 

10. Products and practices are installed. (This milestone requires that the implementation plan 
be followed in order to install the products or practices.) 

11. Products and practices are evaluated. (This milestone requires timely data collection, 
analysis, artd reporting.) — 

1 ' ' - 

• -> Stepl. Collect and analyze data. 

r Train staff in data collection. 



Distribute testing materials. 

^—Collect data. Jl* 

Prepare data for analyses. 

Summarize data fdr each program or activity. 

V 

Conduct analyses. 

Complete analyses of data summaries. 

Prepare tables and charts. 

—Compare desired program outcomes with evaluation conclusio 



i siop 



Z' ' ' —Compare student and/or program, status with*baseHne data from 

needs assessment. 
> * • 

Step 2 Prepare the ev&toation report. ' \\ • ' V 

; . , '-f . - * \ 

** identify, audiences. - \ 

_— ^.Determine appropriate formats. 

incomplete initial draft. - r 



— Revjew draft and revise. 

—Disseminate to appropriate audiences. *i . , 

Further program management decisions* are made. fT|iis milestone assumes that the primary 

purpose of evaluation is to provide information for decision making.) 

*, - 

Stepl. Program decisions are made on basis of evaluation. 

— -.Make formative evaluation decisions: continue and expand; revise 
"'and adapt. > 

_ — Make summative evaluation decisions: terminate; search for a 
replacement; return to former program. 



m 
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rrfepLS FOR EDUCATIONAL CHANGE: N 
Twenty-Eight Techniques for Implementing Innovatior^ * 

This section of the handbook is intended to be used with the procedural guidelines (steps one 
through seven). However, there appears to be a demand for these twenty-eight implementation - ♦ 
techniques. They are packaged separately with the understanding that other sections of the handbook 
are needed for adequate interpretation and use of the techniques. 



. The appearance of any technique in this handbook does not imply endorsement, by the authors, 
the National Center for Research in Vocational Education, or the sponsor.- The techniques represent 
tools that are used to influence other people in the world today. Their application and use is a highly 
individual matter depending upon the skill of the advocate, the conditions in the career education 
implementation environment, and the likely outcome of the use of the technique. The use of these # 
techniques is npn-prescqptjve: an assessment of tjie effect of each technique should take place before 
another is tised.^ * 
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The techniques have been grdered from thye most informative to, the most directive by the 
authors. The informative techniques take more time and provide a great deal of freedom for many 
types of responses. The directive techniques limit -the activities of subordinates; thfey can be carried 
out in a relatively brief period of time. Persuasive techniques' have many uses by project, director's 
because they are effective under many different jponditions. 

It should be emphasized, here that .the organization of the techniques into the three modes 
evolves from the nature of theHechniques and how they are used. ; 



The techniques are arranged within three ^categories, or modes. The techniques also move logically, 
though perhaps hot always sequentially, from one mode to the next. They progress in nature from low 
to high severity, and ifi use from thoughtful care to extreme caution. 



The three modes include the following grouping of implementation techniques, 



ERJC 



Informative 

1. Printed Information 

2. "Audiovisual Material 

3. Mass Media 
4^ Leqtufe f 

5, Symposium \ 

6. demonstration \ 
?. ^Survey Feedback ' 

8. Piscussion " 

9. brainstorming 4 
10. Consultation 



Persuasive 



11. Personal Interview 

12. Role Playing 

13. Cooperation 

14. Staff Development 

15. Differentiated Staff irig 
16. . Involvement in » 

Product Development 

17. Small-Scale Use of 
the Irmpvation 

18. Competition 
. 19, Bargaining 

20. . Promotion of the 

Product '- y 
> 21. Endorsement W 

Authorities, / 
22: Recognition of Trial Users 
23. Financial lnpehtive, 
6 24. Overstatement' * . 



Directive 

25. Deadlines 

26. Legal Mandate 
2f. Fait Accompli , 
28. Strategic Replace- 
ment of Staff 



Adapted from: William L. Lull and N. L. McCasiin 
Development (Goiumbus: The National Center for 
1977). Vt , . , \ 



, Career Education Implementation: A Handbook for Strategy 
Research in VocStiorra! Education, The OhioEta'te University, 
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The definitions section offers brief overviews of the three categories. This sectiorr explains the 
modes into which the techniques fall, and discusses the degree of severity and use of the techniques 
within th^ modes. The section also suggests how to proceed from one mode to another to better 
encourage the mutual understanding and dialogue that contribute to effective advocacy and capacity 
for change. [ * • 

The technique cards provide further discussion. They also include explanations of advantages 
afid disadvantages regarding product, client, and advocate, and will offer advice for realistic, active 
use of each technique. > * 

^ . . DEFINITIONS- 

Informative Mode % 

■■ • . 4 l • ; 

Informative techniques provide bases for considering the merits of the innovation. This raises 
the consciousness ofsclients and orifents them to factors involved in implementing new ideas. Yheso, 
techniques are not, an^[ should not, in aay^vvay be used authoritatively. Clients must nfct see them as 
"mntrnl n nanpuu prs/' or even as persuasion. Clients_shouldi§e these techniques primarily as ways of , 
receiving information that addresses their particular local situations aggfcmdividual needs. Progression 
from one technique to another in 5 this mode should involve consideration of the second Persuasive 
Mode. That is, clients engaging iri any one of the informative techniques.should be aware of the next 
step toward implementation, advocacy, and change: that of being open to techniques that can persuade 
perconsta become involved in actual product and program, competition, development, promotion, 
bargaining, and cooperation to achieve objectives. , > 

Persuasive Mode V 

• ' / •• ' * 

Persuasive techniques involve communication between client and advocate in which the advocate 
takes on greater, responsibility for maintaining dialogue and promoting product and program accep- 
tance. The client, however, must not perceive these persuasive techniques as cdercive measures; the 
advocate must be extremely carefuUhet his/her "persuasive" actions do not evolve into injunction and 
njandate. In thi§ mode, the client must: see himself/herself as becoming capacitated to meet personal 
as vrel I as program objectives. - > 

* < at * • ' 

Directive Mpde ^ ! 

^ ? * ~* \ -6 . . L - ■ ' 

-^Directive techniques limit the options open to thl(cljent. They can be truly effective only if th 
clieht has progressed through informative and persuasive stages. Extreme caution .must be used with 
these techniques in order for clients to feel realistic capacity to implement change Jhat meets-their 
specific needs. Clients must view directive techniques as ''real world" decisions, charges, and constraints 
with which they must deal in responsible ana human faays. Sanctions, rpandates, and specific staffing 
decisions can disrupt progress toward advocacy, implementation, ancj change. Or, they pan successfully 
. confront individuals with necessary compliance with progranp needs. 




1. PRINTED INFORMATION: brochure, article; 

announcement, newsletter 




Printed information refers to any type of message in print, whether it is a newspaper article to 
the general public or a brochure^aimed at selected-teachers on the professional staff. 




DISCUSSION 

Printed information allows the client to take it 
home, $hafe it with others, and re read the message. l " 
It is an extremely valuable tool for developing ideas , 
among professionals and lay persons alike. You, as 
the advocate, have an opportunity to word your 
message carefully and appeal to the rational think- 
ing of individuals. Printed information can'be used 
for mass audiences (to reach persons in the com- 
munity), or it can be targeted to a very'spectif ic 
client, e.g., a memo to a principal in a schodl 
Building. 

The astute vocational education project direc- 
tor will find many ways to use printed information 
wisely. Rational information in ardaily or weekly 
newspaper provides a means of explaining why the 
public should support vocational education. 



THE TECHNIQUE IN ACTION 

frequently, it becomes necessary to establish 
continuing communications with individuals who 
are involved in implementing vocational activities. A 
means for doing this is the weekly newsletter which 
updates people on dates and creates awareness of . 
the product being implemented. . 



/ 
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ADVANTAGES 



As it relates to the product. Printed information provides an opportunity for the advocate to 
describe the product accurately and to provide cues for its- use in the community. 

, ; • \ * " 

As it relates to the client. Printed information allows the client to study comments from the 
advocate and others carefully at times convenient to the client. It also provides documentation 
for action taken both by the client and the advocate. ^ % 



A* it relates to the advocate. Printed information allows the advocate to release ideasselectively 
to clients over a period of time. That is, an advocate may wish/to convey a sirrtole message early 
in the implementation process; later, the message may bScome complex as the problems of imple- 
mentation become more obvious. 1 



DISADVANTAGES 

As it. relates to the product. It may not be possible to adequately explain the merits of the 
product in the spape available. 



As it relates to the client. There may be a tendency for the client to misunderstand the message 
or become unnecessarily excited about the prospect of using the in.iovation. v This excitement can 

take the form of expecting too much from the innovation. (Drfclients may become appreherisiva* 

• v 

As it relates to the advocate. The printed message must be free of technical orsociaf biases since 
]t becomes, documented communication with the plientl Advocates may find it difficult to take 
time to write^he necessary printed messages. ) , * 

u • • . : ' .• ■ v 
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1 AUDIOVISUAL MATERIAL: filmstrip, slide, tape 



This technique utilizes equipment which appeals to the sense of sight as well as sound. , 




DISCUSSION 
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The films and tapes may take many forms, e.g., 
videotape, 16 mm' film, etc. The message is consistent, 
and it provides the^pppdrjunity for a uniform quality 
control. •Clearly, an audience will "retain more of the 

" message when they '/see" the content as well as hear 
the speaker. Audiovisual presentations are cost effec- 
tive for reaching similar audiences in different locations. 
They can be packaged and, synchronized to a talked 

* script for easy transportation. A slide presentation - 
provides additional flexibility. when compared I witha 
fflmstrip. Slides may be adapted to fit the local set- 
ting. • 



ADVANTAGES \ 

As it relates to the product. An audiovisual presentation usually provides the best opportunity m 
tc/discuss characteristics of the product. Photographs may be takenwhich add to the written 
bespoken message. '* . % 

As it relates to the client. Clients' attention-is increased with the use of posters, slides, or other . 
*art work. The message in an audiovisual presentation usually is retained longer by the audience, r 

* • * 

As it relates to the advocate. Audiovisual material gives the advocate a transportable vehide for 
conveying information to diverse audiences in different settings. It can be used individuals 
who have a limited knowledge of vocational education. 



THE TECHNIQUE IN AQTION 

A meeting of a local civic association would - 
be an excellent opportunity for the showjn^of a 
slide/tape presentation. It combines the f lexfWty 
of qonducting a*mall-group meejing with the 
polished format of a presentation prepared in 
**J&nce. 



V 



DISADVANTAGES • . . 

As it relates to the product. The audiovisual presentation requires time and money which could 
be used in other product implementation activities. 

• - As it relates to the client Aprogrammedaudiovisual presentation with a script prepared in 
advance tends to limit the opportunity for questions and discussion. 

.* As it rei*t?s to the advdcate. It may be temptirig for the advocate to use an expertly done 
audiovisual presentation which is obsolete dr irrelevant to the audience. 



'V. 
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3. MASS .MEDIA 



'Mass media is defined as television spots,.radio announcements, newspaper articles, or other 
means of conveying a uniform message to a large and diverse audience. 




CO 



DISCUSSION 

t Advocates use different media for influencing 
various audiences. The use of television drnewspaper 
' articles as a means jpf communicating relatively standard K 
messages to large audiences is vejy cosrtffective. Th^v \: 
need for public information about^pcational educat; A '■ ; 
occurs during the initiatphases ofta prpjecf^r when f here ^ 
a # J$-a£eedt<V(»mmun.cate^^ / * 

> * fully, there«wiH be mVAy,paw^ * 
tional ecjiicaffon ^ctivitfe^to^he pubRd-'The^'aniesbf*^ 7 
studeatstfn^teachers involved jh aptivfti^s &,ould"ba ' ' 
*%PtbB^thepubl|p Professional joy rna Is. rn ay i)e\jse^ . * 
* fo/cqrrtmuinicaje vvith 6ther^xperts?dross the nation, 
*' 4 6i4t the£wouldt>e of little benefit^We^xarrfple/When ' „ 
informing focal taxpayersof*plansfor expanding^ocas • 4 . 
tional education. ■ *r » / *• * 



THE TECrtNIQUE IN ACTION v - . . 

* » « ° • 

*lvTa^ media is an efficient means ofjnforming the 
Jocal community. Newspaper articles can'Be used to . 
make community Viembers aware, of vocational * 
education in the school system. This awareness 
becomes particularly vital to the success, of the * 
program as students are placed in industry and 4 * 
businesses. Jo a lesser extent, this technique can * 
be used to influence school staff rr^rhbers who are* 
living in the community. « 
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ADVANTAGES * ' . * * 

As it relates to the product. Mass media jjrovides^an excellent means of conveying the' relative 
• advantagex>f vocational education in contrast-to other forms of education. Documented facts and 
figures are welcomed by newspersons. . - 

i •JU'Ti •*' * • V \-' * ■ - j " 

As it relates io the'plient- Clients, are aBle to obtein a maximum amount of information* witn 
, very little effort on-jfielopart* *- ' / 

I * > j */ i't * f . s * . t * . * • 

~As\t relates' to Jhe advocate. *Mass media can be an effective rneasns of extendingjhe advocate's 
influence to the community and the public in general. * • 



DISADVANTAGES ^ - ^ . ' 

* As it relates to the product. The public could be led to expect more than the product is designed 
to deFiver. This potential disadvantage can be controlled by the advocate's 8 re!ease of factual in- • 
formation with careful attention to any comment about future events., «. 1 

' - % - * *■ 

-.As it/elates to the client. Th e cljfnt does not always know about the authenticity pf the infor- 
mation provided through mass media sources. This is why it becomes desirable to soli$it.intere$t 
on the pact of the community rnembers to become involved in the project, thus obtaining first- 
hand information for themselves. - > 

. .» . . * # 

• ,* ' • 

As it relates to the advocate. The message transmitted via mass media channels must be stan- 
darclizejl with little opportunity for targeting the corttent to specific groups. Once information 
, has been released to a community via mass media channels, it becomes very difficult to retract. 



GO 
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4. LECTURE 



A lecture is a talk given before an audience to provide information about the innovation^ \ 
: t 7 _t { 
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DISCUSSION 

* . * ,; 

It is easif to overuse the lecture technique/; 

because the project directorjjsually has a better* 
knowledge of vocational educatrorTthan members 
of .h is or her staff or the clients iathe school or 
'community. TKere-aretimes when aJectur^is ^. 
the most appropriate means of communicating • " 
with groups of people. However, implementation 
of a product usually requires interpersonal.com- - 
munication with an opportunity for the listener 
to raise questions and provide comments for the 
>eaker. Small groups,7ather than large groups, 
al^ the rule. Informal, spontaneous communica- 
tion Is more likely to influence others rather than 
formal comments prepared in adva~nce-of the 
meeting. 



—ADVANTAGES/ # ' " 

*^As it relates to the product. The lecture method provides an opportunity for the advocate to 
» explicitly discuss the merits and problems of the product. The notes can be prepared in ad- 
vance, free of interruption land questions by the client. 

As it relates to the client. The client has an.opportunity ^o obtain a vast amount of information 
. inja sjiort lengtfvof time by the lepture method. . -'J*' 

As it relate^ tee the advocate. The advocate of vocational education, e.g., the speaker in a lecture 
situation, has an;dpportunity to convey feelings and impressions as well as information through 
the lecture method. \ . % 



DISADVANTAGES 



THE TECHNIQUE IN ACTION 

s » 
Early in the history of any project it becomes 
necessary to convey a large amount of information 
to a large audience in a limited amount of time, 1 
Frequently, th&etting forsuch ap occasion is an 
auditorium with most of the teachers from a given 
school present. The innovations may be introduced 
using the lecture technique to create awareness of 
vocational education amqng many persons at the 
same time. » 



As it relate* to'the product. Unless lecturer is completely familiar with the product, he/she 
may not communicate its merits to the audience. 

As it relates to the client There is little opportunity for the client to take notes or remember 
what is said in a lecture without supplemental material being distributed. ' 

As it relates to the advocate. The lecture must be prepared in advance and exhibit authoritative ' 
information about vocational education. It requires organization and technical knowledge on trie 
part of the advocate. _ I •* 
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. SYMPOSIUM 




A symposium is defined as a meeting where several speakers deliver a presentation on a com- 
mon topic to ah audience. < ^ * • « 
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DISCUSSION 

The purpose of a symposium ma/differ 
-.depending on the stage of implementation. It 
may be used to inform an audience qf theTnerits 
oia vocational education activity during early stages 
of adoption, or to explain neyv alternatives to the \ 
use of the product. An opportunity would be pro* 
vided to rai?e~questions with the speakers following 
v each presentation. TKe assignment of specific 
topics, and/orvarying points of view which 
are deliberately represented, makes the . ' 
symposium a more formal meeting than - - ' 
discussion or brainstorming sessions. „ 



THE TECHNIQUE IN ACTION 1 -V 

The-symposium may be used to clarify 
or reinforce reasons foY adopting a vocational edu- 
cation activity. Or it may be presented as a debate 
over alternative implementation strategies. 



ADVANTAGES. - " 

As it folates to the product. The symposium allows the product to be fairly represented in 
formal discussion since topics are frequently assigned in advance. '. 

As if relates to the client The technique allows for all sides of an issue to be discussed for the . 
benefit of a mass audience. The user's point of view should be represented. 

• •* . 1 , * " * * ' •. 

As it relates to the advocate.- The symposium can tje used to divert p/essbre on the advocate 
to endorse one position or another. Implementation decisions may becortfe the object of the 
symposium, allowing the advocate^) take rheutral position. 



DISADVANTAGES 

As it relates to the product. Discussions of the product during the symposium are influenced* 
by the capability of the speaker. . v . , « 

As ij( relates to. the client. Trie client views (which are different from those of the advocate) * s 
must be determinecfand assigned to speakers in advance of the symposium dates. It may be 
difficult. to do this; and therefore, the client.may not be farily represented. 

As it relates to the advocate. The symposium may place the adypcate at a disadvantage in 
formulating an implementation strategy. This is particularly true if a well-known and respected 
symposium speaker recommends a pplicy or procedure which is opposed to the one being fol- 
lowed by the advocate. . * . % 
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RATION 



Demonstration is the use of vocational education materials and procedures, as examples 
to illustrate their value to others. m BV; 

I : V ; 



DISCUSSION 

Demonstrations are most effective when the viewers 
. come from schools and communities which are similar to 
the demonstration site. Such a "match" is not always 
possible, but speakers should take every oppo/tunity to 
relate to the'backgrounds of the audience. The demon- 
stration may be used effectively to create awareness of 
potential vocational education opportunities. It i 
may require travel to another school to observe 
aspects of the curriculum in operation. Effective 
use of the demonstration requires preparatiort prior 
to and following the visit. The advocate should tell 
the observers what to look for in the demonstration 
setting. A debriefing session should be held follow- 
ing the trip. This will reinforce observations at the 
site and assist the clients in making use of the Infor- 
mation in their own setting. 



THE TECHNIQUE IN ACTION' 

A vocational education, technique such as the 
use of a community resource person to explain a 
class of occupations present in the community may 
be demonstrated to teachers in a number of ways: 
(1) teachers may be invited to observe a class with 8 
resource person, or 12) a "simulation" could be held 
with the resource^person discussing comments he or 
she plans to male* in front of a class. Another exam- 
ine of the technique is the use of a teacher to demon- 
strate materials in the«pftf2toom/ 
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ADVANTAGES 



As it relates 
practicality a 





I'- 



the product. A demonstrated use of the product removes doubts about its 
appropriateness for specific setting?. , 



As it relates to th> client. Individuals can see fdr thejnselves the effectiveness of the product 
for students. Usually, opportunities are provided to ask and answer 4 questions posed by the 
client. \y, 



As it relates to the adwpte. The demonstration provides a real-life opportunity for advocates, 
to promote vocationaPfeducation in a natural setting. It is possible to capture the spontaneity, ' 
of pupil-centered learning by involving students in the demonstration. 



DISADVANTAGES 

As it relates to the product, 
during the demonstration. Tlj 
product to be exhibited. 



lere may not be time,or opportunity to observe the entire product 
^demonstration site conditions may not allow all aspects of the 



As it relates to the client. The cost of visiting a demonstration site in another school may 6e , 
prohibitive, ff teachers must be ijiway from their classrooms, substitutes must be found. / ^ 

As it relates to tfte advocate. There.rpay be a tendency for the advopate to relax implementation 
efforts once teachers and others have.obServed for themselves the effectiveness of the product. 4 
However, research clearly indicates the need for technical support on the site where implementation 
takes place, ^ • 
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. 7, SURVEY FEEDBACK 


r % 


FEED/(v\ 












Survey feedback suggests a two-step process of (\) conducting a sufvey and (2) reporting the 

results back to the respondent/ • * s 

v > 




N^J BACK (y 





DISCUSSION 



This technique involves the use of a question— 
naire or^other devige for obtaining a'broad base dt 
information from clients over a specified time period 
with a reporj of the summarized data. This tech- 
nique assures clients of some return on their invest- 
ment of time and energy while responding to the 
questions. Surveys are important in the formulation 
of a diffusion strategy because (1) they allow the 
advocate to sample a broad-Base of opinion 'relative * 
.to the acceptance of vocational education, and 
'(2) they provide an opportunity to involve the 
client In a participatory experience. Survey feed* 
* Back is a means of collecting information for • 
rational decision-making.* T 



ADVANTAGES " 

4 - J ' ' <• 

As it relates to the product. Survey>feedback* may identify conditions in the school systefn or 
community wfhich require revisions in the product. . - + 

. . As it relates to the client; This technique allovys clients to respond to suggestions by ttie.change 
advocate. Their willingness to accept innovative activities may be influenced by the knowledge 
gained by reading the survey report, .. . 

;As it relates to the advocate. This technique allows tfye advocate to promote vocationareducatidn 
. and communicate the results of "collective" decision-making. *• 



DISADVANTAGES 



THE TECHNIQUE IN ACTION • * 

Survey feedback could be used in the solici- 
tation, of opinionslfrom the community on the 
desirability of vocational education activities. This 
information cquld become extremely valuable in 
uncovering potential pockets' of resistance to - 
occupatfonally-priented programs i/i vocational . 
education.* . * ** a*. 

• ■ •■ ■ r: 
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As it relates to the product. None. * 

V * " ° * . . * 

As it relates to the client. Rarely will the client have enough information provided to make 
meaningful suggested change* in the vocational education product or implementation procedures. 
He/sheralWays will be responding from a limited information^base. ' ^ li 



. As it relates to the advocate. The use of a survey in the development of an implementation * 
strategy requires time for responses to be summarized, interpreted/ and disseminated. This' , 
additional burden *nay distract the advocate from more importan^planning decisions; 



Y 
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8. DISCUSSION 



This technique is defined as conversation or informal debate among clients orJ>etweej 
advocate and a client. 





V 



iDJSCUSSION^ 

f 

A discussion may be conducted in small group 
meetings which allow opportunities for participants 
to engage in a dialogue with the advocate. Comments 
are relatively spontaneous and informal. Rarely does 
discussion by itself lead to the resolution of stated 
problems. The technique should be viewed as a means 
of creating awareness of implementation problems, and, 
3J to a degree, formulating alternative solutions. The use 
of Veason and/or argument may become prevalent in 
a discussion. Positions may be stated and views 
expressed. The opportunity for criticism of .others' 
ideas is present. 



THE TECHNIQUE IN ACTION 

Teachers rh a school building may be asked to 
discuss the occupational goals held by most students 
upon graduation from high school. In thfsway they 
may recognize the value of "i i/ocatipnal education. 



3i 
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ADVANTAGES 

As it relates to 'the product. The discussion should allow maximum opportunity for all aspects' 
of the product to be reviewed. Both critics and proponents of vocational education should be 
present. ^ 



to mass media 
impression of 




As it relates to the client. Small-group discussion can be an effective fa 
presentations. It provides an opportunity f6r teachers and others to sh 
vocational education. 

\ ... 

-As it relates to the advocate. Discussion can provide for the formulation of implementation . 
strategies. It provides a vehicle for leaders in business and industry to give the advocate advice 
on how to approach teachers and others who are important to, the employment'of vocational 
education graduates. 



DISADVANTAGES 

* 

As it reltrtesjto the product. The characteristics may be unfairly represented by an over en 
astio critic or proponent in the discussion group. ' 4 . - 

,. ' . * ■ • ; . /;. ' - . 

As it'relates to the client. Discussion which is overly argumentative can become devisive and 
can polarize the cjient in his/her future activities with the advocate. : ' . 

* " . # * " - 

As it relates to the advocate. Discussion groups taketime and require preparations^ may not 
be possible for the advocate to participate in as much, discussion of the product as he or she 
desires. . , 
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9. BRAINSTORMING 



Brainstorming refers to the use of small groups to generate bright, potentially useful ideas. 




CO 



DISCUSSION 

The technique works best in groups of three to 
seven individuals. Sometimes it is desirable to declare 
a moratorium on all criticism. Particularly, thismay 
be done in the early stages of the interaction to ailow 
ali possible ideas to be suggested to the group. This 
may result in some unique contributions from staff 
members which, with revisiortTcould lead to novel 
solutions of a problem. The technique is not de- 
signed to*answer questions; rather, it is an attempt 
to solicit new and varied suggestions from persons 
with different backgrounds and competencies. 



ADVANTAGES 

• » * *^ 

As it relates to the product. Brainstprming sessions may reveal unique and appropriate ways 
of applying vocational education to the local setting. Such assistance to the advocate could result 
in major adaptations of the product. ~w „ L ' * 

As it relates to the client. This technique allows for involvement by potential users of vocational 
education. They have the opportunity to contribute meaningful suggestions for implementation 
which are likely to facilitate acceptance of the product. ! 

As it relates to the advocate. Brainstorming assists the advocate in formulating implementation 
strategies: It casts him/her in a helper role which should increase rapport with the client audience. 



THE TECHNIQUE IN ACTION 

There are many opportunities to solicit new 
ideas via the brainstorming technique during the 
implementation process. For example, the vocational 
education staff may be called together to suggest ^ 
ways to approach the business community for place- 
ment of more students in work-study situations. 
' Another example of this technique would be the use 
of elementary school teachers to suggest alternative 
methods for incorporating an instructional package 
into the curriculum. • 



DISADVANTAGES / 

As it relates to the product. Some of the product applications suggested may not be appropriate. 
If used, such changes could destroy the benefits of vocational education.' 



As it relates to the client Clients may .leave the brainstorming sessidn somewhat frustrated 
since no attempt is made to reach consensus. Participants in brainstorming are viewed as 
advisory only in the formulation of implementation strategies. % 
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As it relates to the advocate. The advocate must be;sufficiently open-minded to consider 
the sometimes novel ideas suggested by the cljents. 



y 



.,4 



v 



10. CONSULTATION 



^Consultation refers to tbVact of giving advice to a client, usually at the client's request. 




CO 
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DISCUSSION 

Consultation may include' a wide range of activities 
Rich as djagnpsjng the situation, refining a request for 
information,jbr*adapting the product to unique needs of 
the locafsituation. It is used most frequently in the 
initial phases of the project to conceptualize and evaluate 
needed changes in trte product or the adoption situation. 
This collaborative endeavor between a change advocate 
and a client may be used to encourage friendship and 
trust. I^may be used to influence the outcome of a 
decision; but, usually; the consultant conveys informa- 
tion about the product or adoption situation in an ob- 
jective mannef. Consultation occurs most frequently 
on a one-to-one basi s. However , a consulta nt may be 
invited to work with a group of teachers during in- 
service education, 



ADVANTAGES 



As it relates tp the product. Some products require adaptation to site conditions as they are 
being implemented. It is natural.and desirajble to call in the developers of the product to con- 
sult with local school officials for changes* to be made in the product. 

As it relates to the dient. Most clients view consultation as an excellent means of communi- \ 
eating their needs^o advocates of a new program. It provides a forum for discussion of ideas 
which can effect the local situation as well as changes in the product. 

• ' .. '•• ' * 

As it relates to the advocate. It is to. the advocated advantage tq consult with clients and experts 
whenever possible. It provides information to the advocate as a basis for project implementation 
decisions. During the consultation, the advocate has an opportunity to establish rapport wijh 
the.client and others involved in the implementation process. * 

i • 



THE TECHNIQUE IN ACTION 

'* Consultation is especially useful in obtaining 
highly specialized expertise which is not available 
among project staff. A vocational education project 
director may wish to use consultation in the design 
of procedures to assess* the impact of the project 
.on student growth and development. 



DISADVANTAGES 

As it relates to the product. Unless the consultant has been 'previously associated with the 
product, he or'she may have some difficulty in understanding the product in the time available. 

As it relates to the client/ The consultant may be perceived as an outsider who does not under- 
stand, the problems and concerns of the persons who must use. the product. The consultant 
may have limited knowledge of the actual needs of the clients. * . . ' * 
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As it relates to the advocate. The consultant may give the advocate unsound advice, or the 
consultant may be critical of the advocate's implementation procedures.; . '•' 
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11. PERSONAL INTERVIEW 



This technique consists of an interpersonal conversation between two persons, an advocate and 
a client. \ 




DISCUSSION 

The personal interview allows for much 
freedom and flexibility when discussing vocational 
education. Usually, the interview takes place in 
an office or teachers' lounge. Relative privacy 
is assured. Both the advocate and the client 
(parents^ teachers, administrators) should feel 
"free to express themselves. A personal inter* 
view provides an opportunity fop the advocate 
to build -a personal relationship with the client. 
This should lead to mutual trust and incremental 
goat setting for the implementation process. 



THE TECHNIQUE IN ACTION 

It sometime* becomes necessary to obtain 
Jhe attention of the decision-maker in the 
school system. Building principals and persons 
in the superintendent's office are busy. An 
advocate should make an appointment with 
the administrator and show him or her the 
courtesy of an individual, private conversation. 



ADVANTAGES . 

As It relSfes to the product.^ The personal interview provides an opportunity for close scrutiny 
of vocational education. Specific objections and/or benefits may be raised in an atmosphere of 
mutual trust and consideration. \ 



As it relates to the client. The personal interview may be scheduled at the discretion of the 
client. This convenience and special attention may result in more favorable response to the 
advocate's demands. " ' 



-4 



As it relates to the advocate. It provides a unique opportunity to display the benefits of vocational 
education in the atmosphere of the client's off ice or home. This setting allows the advocate to 
observe informational and other professional needs of the client. 



DISADVANTAGES 

As it relates to the product* It is not always possible to transport the product to a private office 
or home setting. Therefore, it may become necessary to use photographs or other information when 
iplaini 



As it relates to the client* None. 



As it relates to the advocate. Use of the personal interview technique requires a great deal of 
time and a sense of timing on the part of the advocate. An inexperienced advocate may not ^ 
be able to organize his/her schedule sufficiently to effectively utilize this technique! 



12. . ROLE PLAYING 



The assignment of a-Jjosition or function to an indlvidual'for the purpose pf acting out a 
simulated situation. . , 



DISCUSSION . „ 

Vocational education requires nontraditional 
roles and duties for school staff members, e.g., the • 
visitation of school staff to businesses for the super- 
vision of student-employees. Such duties may reqiflre 

^school staff members to change familiar routines.'- - 
Role playing is a useful technique for the purpose of 
sensitizing staff to the problems and barriers they are 
likely to confront in new situations. Occasionally, 
the technique can Be used to .aid a staff .member with 
problems he or she js having ? on the job. However, the 
use of the technique as a therapeutic device should 
Occur only under the supervision of a highly qualified 
individual. It is not recommended for use in this . 

* manner by vocational education.advocates. 



THE TECHNIQUE IN ACTfbN 

• Frequently, the implementation of. vocational 
education requires individuals to be placed in new / 
and unfamiliar roles. Former teSchers may be asked / 
to become coordinators of vocational education for* 
more than onfe building. This calls for an ability to' 
schedule their activities and develop interpersonal ' 
relations with several principals as well as staff rnqm- 
:bers in those buildings. The role-playing situation / 
can be useci.tp elert new coordinators to problems 
they are likely to encounter. • £ 



D VANTAGES 





As it relates to the product. The role-playing activity may make it possible to anticipate prob- 
lems in the implemehtatiorv process. This>hould result in better understanding of the ptpauct 
.. and a more systematic implementation process. I ■ > 

As it relates to the client, the preparation and development of staff rjiembers contributes to ^ 
• thfir receptivity to vocational education. It fs absolutely essential to assign competent personnel 
tq Implementation roles. t, V 

Arft relates to the advocate. Role playing provides' the advocate with a technique for sensitiz- 
ing individuals for implementation of .vocational education activities, ft Is particularly helpful for 
staff members who are changing roles. f ' t jfr 



DISADVANTAGES 
As it relates to the product* "None. 



He or 



As it relates to the client* She technique requires careful observation by the supervisor, 
she shojuld look .for miscues in the situation and correct the aptors accordingly. 

' - '; ' ° V " , < ) 

As itrelates to the advocate. The advocdft must be able to determine the Individuals most 
liker>*>. benefit from role playing. This isTdifficuft to do and at times results in sessions that 
are nothelpful. 



13. .COOPERATION 



■f 



Cooperation refers to an associatiorr of individuals, formed for the purpose of achieving joint 
"objectives for common benefit. ? 

^ : — . : ^ 
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DISCUSSION 

This association of individuals can be between 
the advocate and the client or among clients. The 1 
***r*reason for cooperating is the implementation* of 
vocational education. Liaison must be built and 
maintained between the project director and opinion 
leaders in the client group. Extending cooperation 
on relatively minor services, e.g., the providing of 
3 information on specific topics of interest to indi- 
-* yiduals, can go a long way toward facilitating the 
use of vocational education products. 



THE TECHNIQUE IN /yCTION 

Some school districts have banded together to „ 
share resources and provide leadership in vocational " 
education activities. Such cooperative endeavors are 
intended to emphasize strengths and overcome weak- 
nesses present in each individual distrlbt. 



ADVANTAGES 4 * ' . 

As It relates to the product, "hie mutual benefits whfch accrue during cooperative activities 
tend to overcome implementation problems and reflectfavorably on the product. v£ 

■ ■ ' ' 

As it relates to the client Cooperation makes available to any individual in the client system 
resources of other people and school systems. This sharing of information and concern for 
implementation activities are likely to have a. positive effect. 

* ♦ 
As it/elates to the advocate. Cooperatiqn extends the influence of the advocate through a" 
network of individuals and agencies concerned with implementation of higtt quality vocational 
education programs. * * 

DISADVANTAGES. * 

As it relates to the product. Cooperation sometime* slows the process of implementation 
which may cause problems in scheduling the use«of the product. 

'--'J ■ ■ '' : 

As it relates to the client At times it may be^necessary for the client to give priority to another 
party's concern for implementation problerr/s. This disadvantage is offset by the probability of 
the advisor gaining insight on how to improve the implementation of vocational education 

• '; » • • •■. '• .. • * 

Ac it relates to the advocate. The primary difficulty in using cooperation as a technique is 
the amount of time required to coordinate and supervise cooperative activities. ;lt would be 
possible for the advocate to become so involved in cooperating with other people that imple- 
mentation objective^wpujd not be met. 
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14. STAFF DEVELOPMENT 



The acquisition of new skills necessary to accommodate the innovation is the intent of this 
technique. * 




DISCUSSION 



ADVANTAGES 



o 



Any new idea, product, or material usually , 

t quires skills not present among existing staff.* 
ather than dismissing staff and hiring new per* 
sonnet, it, is usually more efficient and effective to 
upgrade selected individuals in their position. The 
staff development workshop is an excellent tool for 
explaining vocational education and conducting 
instruction on a day-to-day operation of the product.. 
Long-term investments in staff development could < 
best be handled through credit courses or other 
programs designed for the continuing imprqvement 
of staff capabilities. Summer workshops, as well as 
inservice professional days during the school year, 
provide opportunities for staff development. . 
Frequently, in large school systems, staff members 
work together to learn new roles associated with 
the innovation. This subsequently boosts morale 
in many cases. ^ 

THE TECHNIQUE IN ACTION 

Vocational education often includes coordi- 
nation of employer-based work experiences with the 
school program. Many teachers have hot been exposed 
to the world of business and industrvyt may be desir- 
able to conduct an inservice training workshop on the 
coordinator's role in vocational education. 
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As it relates to the product. Staff development activities create a better understanding of 

toncepts and improve capability for implementing vocational education activities. 

! 



As it relates to th^client. This technique assures staff time is allocated to the development of 
professional competence. This can become extremely important to the coordinated use of selected 
aspects of vocational education. 

* ** 

As it relates to the advocate. A staff development workshop provides the setting for the ad- 
vocate to promote the product and instill the desire to use it. In addition, staff development 
activities may take the form of adaptatiorfof the product to local conditions. The setting ' 
also provides the opportunity for using consultants and experts to demonstrate selected as- , 
pects of vocational education. 

■ 9 \ 

\ • ■' 

DISADVANTAGES 

As it relates to the product. The staff development session may be too brief to allow a good ,* '•'. 
understanding of the product. . „ 

As it relates to the client* Staff] members may not attend the workshop! It may require credit 
or pay for the extra hours invested in the workshop. Staff may not see the need for this activ- 
ity, or they may feel that the e; istence of the workshop indicates their present : activiti^are 
not acceptable. * /1-C> ^ 



As it relates to the advocate. 5ta£ development activities require time and resources in 
# preparation. The advocate rtiay not be ^ble to schedule staff djtvV^^^ 
hours or at times when teachers are available. ^-J^K:^'^ ; "I " 
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15. DIFFERENTIATED STAFFING 



Differentiated staffing refers to the, assignment of differential duties and responsibilities' 
among the product implementation staff members. 6 * . 




DISCUSSION 

This management technique uses professionals, 
technicians, and laypersons in a manner which is con* 
sistentwith their knowledge^ experience „and capability. 
Specialized tasks are assignee to different members of 
the team. This placement of responsibility brings with 
it accountability for achievement of these specialized 
tasks. Also implied is the need for coordination of 
team members' activities. Under most circumstances, 
particularly in small school .systems, this coordination 
is the responsibility of the vocational education ' 
department chairperson. 0 « 



THE TECHNIQUE IN ACTION ~ 

Differentiated responsibility frequently occurs 
|5^tween^uilding coordinators of vocational educa*' 
^rilfmfteachers who jre heading a substantive 
service area* For example, the teacher of home eco- 
nomics would be responsible for integrating vocational 
education concepts intp'instructional materials for the 
grade levels in that department* The/coordinator of 
vocational education would lend advice on the place- 
ment of these concepts at specific grade levels. The 
coordinator .would act as liaison between scheduled 
tearning experiences in home economics and other / 
areas of the students' curriculum, e.g., science, mathe- 
matics, and English. ~ *; < ^ 



ADVANTAGES * ' : 

As it relates to the product. Differentiated staffing provides a means of marshaling the most 
competent individuals to implement the product. Each implementation task should be assigned 
to the appropriate person. ♦ s 



As it relates to the client. Teachers and administrators know wJiq is responsible for achieving 
specified implementation tasks. E§ch person assigned should be the "best" qualified person to* 
perform the duties; this should lead to increased job satisfaction. 

^As it relates to the advocate, Differentiated^ affing allows the,advocate to refer questions and 
inquiries to appropriate individuals. Competeht^esponsible team members should make the 
tasks of advocacy easier. . 



DISADVANTAGES 

As it relates to the product Individual? may become so specialized that they lose a sense of 
balance for implementing the complete vocational education product. \ <, 



As it relates to the client* It may become difficult to reach the project director if bureaucratic 
channels are maintained. Likewise, it may become necessary to contact several individual pro]- 
ect staff members before an inquiry is fully answered. , * 

* 1 ; . * 

Ar it relates to the adtfocfcte. The vocational education project staff may- become so specialized . 
that no one is-avatlable tcr respond to general questions. from the community or(other:sources. 
Responding to such requests may place an unreasonable burden on the project;director. 

L L* — ----- ' — ^ .: • s? - ^ "y \'-\^ ' 
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16. INVOLVEMENT IN PRODUCT DEVELOPMENT 



'This technique may s bff defined as the use of local, on-site staff to modify existing educational 
materials for the purpose of adapting them to local conditions. 




DISCUSSION 

This technique appeals to the professional 
dedication and desire of staff members to contribute 
to the improved education of students. By modify- 
ing vocational. education products to reflect local, 
standards and conditions, teachers and administrators 
become drawn into the adaptation activity, thus 
^ accepting some of the objectives and goals of the 
S program. The opportunity to create and/or 

modify an innovation can be used as an incentive 
for soliciting staff support. » » ' 



THE TECHNIQUE IN ACTION 

Frequently, teachers are asked to revise an 
instructional package. This opportunity provides 
them with recognition and influence over instruc- 
tion which may be used throughout the school 
district. The development and/or revision of voca- 
tional education materials may take place during 
summer workshops specially designed for teacher 
inputs. 



ADVANTAGES 



As it relates to the product. The opportunity for many staff members of a school district to 
modify vocational education materials or procedures is viewed as a positive^echnique. The 
changes in the product should reflect local needs. 



As ft relates to the client. The revision or adaptation of vocational education materials leaves 
teachers and others with a sense of pride and owpership of the product;' ^ 

* as ' 

«* '* 

As it relates to the advocate. Participation of school staff in product development activities 
creates involvement in the project. Several people working together tend to extend the 
influence of the advocate. 49fr < 



DISADVANTAGES >» 

As it relates to the product. The revision and/or adaption made local staff may disrupt the 
systematic implementation of the vocational educaiioh program. In the extreme, changes made in 
the product could create incompatible situations which destory.the original intenf of the mate- 



rials. 



As It relates to the client. Teachers and other staff members available to modify the product 
maydack the requisite experience and knowledge. Thi* lack pf capacity within many organiz- 
ations limit* the opportunity to Use this.technique. «. . 



I ERIC 



124 



As it relates to the advocate. Time may not alloW'the optimum'utiRzation of staff to adapt the 
product. If major modification takes place, the advocate cannbt verjfythe validity and/or ' 'U 
reliability of the. untested materials. ' "* . ^ * 




17. SMALL-SCALE USE OF THE INNOVATION 



The intent of this technique is a small-scale commitment of /esources (funds or time) by the 
host site. 




DISCUSSION 

An implementation strategy which allows a 
product to be tried incrementally or as segments X>f 
a total product is more likely to be successful than 
an all-or-none implementation approach. It is much 
easier to add to a project rather than to cut back, 
when unforeseen difficulties arise. Clients need time 
to become acquainted with a new idea. The ability 
of an advocate to present vocational education in a 
clear and immediate manner will enhance the proba- 
bility of acceptance by the client. Some materials 
must be used as a unit while others can be segmented 
more easily. 



ADVANTAGES : - . 

As it relates to the product. The trial use of vocational education activities allows for adaptability 
prior to a full-scale implementation commitment. 

As it relates to the client. Clients have an opportunity to become familiar with vocational education 
product by product. This procedure reduces confusion and keeps the client from becoming 
overwhelmed by too much responsibility. 

As it relates to the advocate. The initiation of a small-scale implementation activity increases 

the probability <Tf future growth and tends to. mitigate against failure. Schools selected for _ 

initial trial use tend to be innovative and accepting of new ideas. 



THE'TECHNIQUE IN ACTION 

w A school superintendent may wish to try 
innovative vocational education programs in a single 
School building or arefbf the district before com* 
mitting funds to full-fledged implementation. This 
allows intensive implementation activities in schools 
with active opinion leaders. ' * 



DISADVANTAGES - 

As it relates to the product. It may not be possible to obtain a clear conception of vocational 4 
education by viewin^segments in different locations throughout the district. 
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As it relates to the client. The small-scale use of the product in innovative schools miy not be 
representative o'f its performance under real world conditions. 

As it relates to the advocate. The installation of vocational education pilot projects in several 
different locations throughout the district may tend to delay the implementatioaof rrlore 
comprehensive product implementation activity. Th^advbcate.must- recognize the artificiality 
of investing implementation money^within very limited scopes of work. 



18. COMPETITION 



Competition refers to the actions of two or more indivfduals who are interested in obtaining 
the same desired objective^ % 




DISCUSSION 

The key to the use of this technique, is thfe 
motivation of the teachers or others who are to be 
associated with the project. Recognition, financial 
incentives, or other techniques may need to be 
used in ponjunction with competition. Competition 
can be used to make people* more aware of career 
education and generate enthusiasm for the imple- 
Q mentation activity. Certain prerequisites must- be 
observed: ( 1 ) the objectives of the activity must 
be clear in the winds of those competing, (2) the 
individuals engaged in competition should haVe an 
equal chance for achieving the desired objective, 
and (3) the results of the competition should be 
known to all. 



ADVANTAGES 

v As it relates to the product** The effect of competition upon others usually tends to create a 

desire to use the product. In this case, a viable vocational education program would be the objective. 

». * * 

A$ It relates to the client. Teachers and students like to engage in competitive activities. Prizes 
should be awarded to the winner. Recognition and some prestige should accrue to the partici- 
pating individuals. 

As it relates to the advocate. This technique enables the advocate to select from a broad range 
of individuals who are interested in becoming a part of vocational education. It places the respon- 
sibility for involvement on the client rattier than the advocate. - ~ 




THE TECHNIQUES ACTION 

Competition may be used as a means of 
■ ^selecting volunteer teachers to pilot test vocational 
education activities in-a school building. This assumes 
the teachers are Interested in vocational education 
and believe they will benefit from their association 
with the prograrh.in some way. 
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DISADVANTAGES ^ 

As Prelates to the product* The quality of the implementation activity could get lost irvthe 
spirit of competition. The individuals could becomefo concerned atxiut who was selected for 
an activity that product quality could suffer. V* r* , 



As it relates to the client. Competition could become so keen as to distract 'the client from the . 
primary task of using the vocational education materials and procedures. 

As it relates«to'the advocate* The notion of winners and losers is implied in competition. Losers . 
should be compensated With other incentives! The advocate is responsible for assuring this com* 
pensation. * / , V 



■ - bis 
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This technique usually 

*a union reprajmtatiye^^ ; '■*" ~" 9 



DISCUSSION 



In recent years, bargaining^aijxcpme. 
associated with the renewal otcqhtractt.betwee'iv. 
a teachers; union and a school district; While'. : \ 
thisi* the most f requenAise of the technique, ' 
selective aspects of bargaining take place in many: 
day^p«Jay^exchan§es between the advocate and 
those near him/her. This technique is used most.f 
appropriately when those involved possess an * 
equal power base. Rarely is bargaining effective 
with a superior or a subordinate; it usually occurs 
6n an organized group basis. The elemerit of v ~ 
compromise is seen as essential in this process. 



ADVANTAGES' 




jAs it refates^to the product. None" 



f 



As if relates to the client The use of Jrargaining in a negotiation frame of Reference can be a 
powerful-tool for the promotion of special interests. Teachers and other groups can gain ^ 
concessions by offering to try new ideas for the school system,- * * 



As it relates to the advocate/ Bargaining gives the advocate the opportunity io influence a 
large number of peogje by ne^btiating, with their representative. Used with discretion, it can 
be effective in Implementing vocational education.. 



THE TECHNIQUE IN ACTION 

% The career education advocate may find , 
it necessary to meet With officials of the teachers' 
union on days set aside for the inservice education 
of staff in order to establish vocational education as 
a high priority. Bargaining could occur over the 
decision to set aside funds for this activity.' 



DISADVANTAGES • • - • ■ 

As it relates to the product. Involvement in negotiation can become so time consuming as to 
detract from the use of the product. 

- -„ * • '* 

As it relates to the client. The clients may perceive themselves as "losers" in the negotiation 
process. This,c6ujd result in a reluctance to implement the product. - 

* * » .• « ' * * 

As it relates to the advocate. The client may wish to attack other issues in the negotiation for 
- career education implementation activities. This could confuse the situation and tend to* reduce 
» the effectiveness of the implementation activities. 
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20. PROMOTION OF THE PRODUCT 



This technique contributes to the perceived value of a product by providing information 
which emphasizes its positive characteristics. 



, DISCUSSION 

The purpose of this technique is to convince 
£he client of the desirability of using vocational 
educatipn materials and procedures. This is done by 
^supporting claims for the product with factual infor- 
mation as. much as possible. Particular aspects of 
/ vocational education may be emphasized as a unique 
v -* solution to a local problem. This promotion may 
3-8 take the form of endorsements by credible sources 
* of information. Community leaders, school officials, 
and students are effective promoters of the product. ^ 




ADVANTAGES 



\ 



As it relates to t(ie product. Promotional materials such as well designed brochures and posters 
tend to leave positive impressions -of vocational education in the mind of the reader, * 

As it relates to the client Most people welcome the opportunity to gain more information and 
insight into an innovation. . 



As it relates to the advocate. Promotional materials make the job of the advocate easier. 
Leaflets may be left with an audience after a presentation to help them thinj^about the 
product. 



THE TECHNIQUE IN ACTION * 

Promotion of the product through leaflets, 
posters, mass media announcment, and other forms 
of written/verbal materials is most effective in 
creating awareness of vocational education concepts 
and procedures. 



DISADVANTAGES 



r 



As it relates to the product. Usually the message is standardized, allpwing a minimum oppor* 
tunity for unique applications of the product to a local setting^ — 

As it relates to the client. The promotional materials may raise the clients' expectations for 
high performance. Clients may be^ somewhat suspicious of a large amount of promotional 
information. . ' A 

^ \ , ' m 

As it relates to the advocate. It mJy4» not be possible taanticipate exactly those aspects of 
vocational education that are likely to appeal most directly to clients' values and needs. 



21. ENDORSEMENT BY AUTHORITIES 



3 



This technique is designed as an expression of approval of the innovation by persons who are 
respected by members of the user audience. 




DISCUSSION 

Authority may be derived from an official 
position such as that held by a school principal or 
from informal associations of the type exhibited , 
by an opinion leader. Individuals frequently makti 
decisions on the strength of recommendations from 
their friends. Persons with high credibility are capable 
of lending intellectual and social support to users of 
vocationaf education. Teachers and others in the- 
school system need to be reminded periodically of ' 
the inrvportance placet} on vocational education by. 
the superintendent arid building princfpal. 



ADV^N&GES 

As it relates to the product. The product is likely to receive more consideration by users if 
they know it has the approval of authorities. 

As it relates to the client! xThe use of credible individuals in the development and adoption of^ 
vpcational educationjnaterials tends to develop confidence in the client They feel free to express 
their concern to the opinion leaders. ' . 

. >' . ! • \ 
Ai it relates to the advocate. The endorsement of the product by respected individuals extends 
the network of advocates. iHnakes the implementation task easier and broadens the base of 
support for vocational education.* * 



THE T^HNIQUE IN ACTION 



One way to'gain the confidence of local 
business persons in the community is to obtain the 
endorsement of a civic organization. Such»action 
seems tof legitimize vocational education activities j 
in the community. Another example of the use of , 
' this technique is.the selection of respected teachers 
in school buildings to try innovative vocational 
education ajrtivities. . 9 { *s • 



DISADVANTAGES 

* * 

As it relates tovthe product The product may.be rejected without receiving due consideration 
if the endorsements are<perceived as directives.' 

As it relates to the client The intended users of the innovation may not agree with the com- 
ments and opinions of authorities. The clients may not perceive the endorsers as members 
of their group. ° * 4 k 



As it relates tojthe advocatb. It may take time to identify th^ppropriate opinion leaders in 
the client group. The opinion leaders and other authorities may not be willing to give their 
full support to the innovation. >% 



22. RECOGNITION OF TRIAL USERS 



This^tfcchnique refers to the special attention given to early users of the innovation. 

w , : • 




V 



DISCUSSION 

Every individual. wants to foe respected by 
others. This desire sometimes motivates them to 
volunteer for assignments that contain a certain 
amount of risk arid uncertainty. Individuals who . 
^perform well under thesrconditions deserve recog- 
nition as early users of vocational education mate- 
rials and., procedures. This technique goes hand-in- 
hand with other techniques listed in the publication, 
such as *the"'solidtation of volunteers who are com- 
peting for the pnwfeg^of being involved in the 
project. 



THE TECHNIQUE IN ACTION ' 

There are many ways t*recognize the contri- 
butions of those involved in vocational education: 

(1) their work could be displayed on bulletin boards, 

(2) articles about their vocational education activities 
coulcl be published in the local newspaper, or (3)* 
the^ could be asked to demonstrate exemplary voca- 
tional education practicesto other teachers in the 
district 



ADVANTAGES 

* * * 

As it relates to the product. If participants in vocational education/like what they do, and are 
recognized for it, the quality of theiyberformfence should contributiTto the effectiveness 
of the product. * f 

'As it relates to the client. Recognition givevthe client a sense of pride and confidence in 
themselves. It should be consistent with peer group expectations of the individual. 

As it relates to the advocate* It provides the advocate with an avenue for rewarding outstanding 
performance. Such recognition tends to influence other persons in the district thus establishing 
expectations for high performance on the project. 



DISADVANTAGES t 

> As it relates to the product* This techhique can be overdone. , The timaapeftf on congratulating 
project staff could dfetract from product development and implementation activities. 

, , * ? 

As it relates to the client. Some clients may feel the recognition is not merited or tends to, 
downgrade the contributions of other staff members. 

As it relates to the advocate. The techhique could be time consuming. Fair judgments about 
the contributions of staff members must be made. ... * 
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23 A FINANCIAL INCENTIVE 



Financial incentive is the use of money to encourage involvement in some activity or 
program. ^ ~v , 




DISCUSSION . 

Implicit in this technique is the concept of 
"pump priming/' This is the use^of initial funds to 
encourage use of products and materials for a short 
time. Another approach is the use of iunds to match 
state or federal monies. Most individuals require 
some incentive for involvement in any new activity. 
Innovations in vocational education ask teachers and 
administrators to invest time after school and on . 
weekends to develop and implement nevy ideas. This 
time should be compensated with rewards (recogni- 
tion or money). * 



THE TECHNIQUE IN ACTION 

Funds may be used to pay substitute teachers 
for classroom activities during the development and/or 
modification of vocational education materials. Funds 
are necessary if teachers are to be transported to other 
sites wtfen viewing vocational education activities. 



ADVANTAGES 

As it relates to the product. Priorities should be place on those activities most essential to 
product development and implementation. One way to do this is to budget fgnds for staff 
inservice activities. * ' 



As it relates to the 'client. Financial incentives serve to motivate individuals to excel in 
performance. Funds should be available for instructional materials or other needs of clients . *. 
who perform on assigned tasks. ' 

As it relates to the advocate. Financial incentives may be used selectively for hfgh priority 
tasks. Some budget flexibility should be s maintained when implementing vocational education 
nrfeterials. ■/ ' A ' " 



DISADVANTAGES . J . 

As it relates to the product Monies diverted to implementation activities are not available to 
further develop and refine the vocational education procedures and materials themselves. 

r • .. " : % ■ .. 

As it relates to the client. Individuals may not be available to take advantage of the monetary 
remuneration paid for additional work performed. * 

As it relates to the advocate. The advocate may 'not have the authority to spend money from 
selected categories of thebudget. 



J 
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24. ' OVERSTATEMENT 



Overstatement is the deliberate use of strong demands in an effort to gajn an advantage over 
competing courses of action. * • 




DISCUSSION 



This technique is designed to influence others by 
citing extreme examples of the need for the product. 
Overstatement is most often used in negotiations to 
bargain for power. Frequently, it become necessary 
to compromise with the other side. This is particularly 
> true if the overstatements are not reasonable. You 
should be prepared to back down on your demands in 
£j the interest of moving forward with product implemen- 
tation activities. .By relaxing your Qemands, y^can 
gain credit from the other side and reach a compromise 
, solution to the problem. 



THE TECHNIQUE IN ACTION ' . 

The inservice education specialist may describe 
in detail the knowledge and skill needed by staff when 
bargaining witfr.the representative of the teachers' . 
union for inservice time with teachers. Teachers' ♦ 
professional days on the school calendar are limited; 
usually, negotiation is required to obtain these days * 
to address specific topics. * „ 



ADVANTAGES 

As it relates to the product* This technique tends to place the product in Its best light. 
Overstatement of the need tends to increase the desire of the client to install the product. 



As it relates to the client None. 



As it relates to the advocate. Overstatement gives the advocate an initial advantage in 
negotiations; however, this advantage may be diminished when the other side realizes the 
advocate is willing to compromise his position. 



DISADVANTAGES 

r , ' 

As it relates to the product. Overstatement of need for the product may create-an unrealistic 
expectation for what the product canichteve. 

>■ 

A$ it relates* to*the client. The use of overstatement by an advocate places the client at a 
disadvantage because the client does not know what to believe. This delusion is reinforced 
when the advocate backs down from the previous position/ < 
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As it relates to" the advocate. Overstatements about the need for the product must be carefully 
timed to be effective. The advocate may misjudge the readiness of the other, side to compromise. 



' " 
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25. DEADLINES 



This technique sets a date or a time as a means of schedulin^implementation proces&s. 




DISCUSSION 



ADVANTAGES 



Thrs technique assumes that the advocate has 
the authority to establish deadlines. Their enforce- 
ment can be a* problem because unforeseen circum- 
stances tend to interrupt scheduled activities. Never* 
theless, the technique is useful for planning purposes/ 
The deadline encourages .users to pursue project 
goals, and it establishes a mechanism for account- „ 
ability. Realistic timetables are essential. Deadlines 
are of little value unless they are maintained. 



THE TECHNIQUE IN ACTION 

The development of vocational education mate- 
rials usually requires advice from a number of people. 
The deadline may be used to curb extensive commit- 
tee work. It serves to orient individuals to tasks and 
sets expectations for the completion of products. 



As It relates to the product* The deadline provides target dates for incorporating vocational 
education into field sites. It c&n serve to4ncrease product effectiveness if sufficient time and 
money have Ijeeri allocated for implementation tasks. 

*" ' - , 9 . , 

ft « 

f « « „ > 

As it relates to the client. Time deadlines can orient clients to tasks; Realistic due dates can 
pace the work load toward the completion of task°s. 9 • 

As it relates to the advocate* Advocates can £se tirrte dealines as a mechanism fof monitoring 
the implementation of products and procedures.. Deadline^ can serve to highlight areas of need* 
for more funds or attention in the implementation process. / * *s 



DISADVANTAGES 



V 



As it relatertb the product The deadline*may be superficially Imposed without regard for.the 
nature of the task. Product development rfiay falter in order to give fhe appearance of meeting 
implementation deadlines. * * . . 



As it relates to the clientx If the deadline is unrealistic, the client is likely to object* . The dead- 
line does not intrinsically contribute to the implementation process. It dpes t serye to alerfthe \ 
clients as well as others to the progress of ihe implementation aptivity. / 



As it relates to advocate. Anxiety levels for the advocate's staff ar£ likely to increase 

if deadlines are hot met. It may become necessary % to adjust deadlines in view of unforeseen 

circumstances. ' 
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26. LEGAL MANDATE 



y Thfs technique is defined as an authoritative command as in a school board decision, legislative 
\ enactment, or judicial decision. ^ 




DISCUSSION 

Compjiance with this command is expectfed. 
Legal sanctums may be imposed for the purpose of 
implementing inno^ions. The mandates are most 
often given/by local^tate, or national governments. 
They are sometimes enforced. through court actions 
or by relating reimbursement policies to compliance 
with the mandate. The legal mandate is most effec- 
tive when rapid use of an innovation is essential. 



THE TECHNIQUE IN ACTION « 

Legislative mandates 3t the national and state ' 
levels established relationships between} vocational 
education agencies and community-based organiza- 
tions. The, effectiveness of these relationships depend 
on the spirit of cooperation among people in these 
agencies* v 



ADVANTAGES * 

As it relates to the product. It assures some%nplementation of vocational. education 
practices by a specified date. Usually, such mandates are not related directly to a 
particular product Adaptations of the product may occur as needed. r , 



As it relates to the client. The legal mandate sets expectations for use of the product. It 
gives the client a date for the completion of implementation activities. 

As it refates ti the advocate. The use of legal commands generally caffassure minimum 
compliance. The advocate must use this technique carefully to minimize resistance. 



DISADVANTAGES , 

At it relates to the product. Rapid implementation of vocational education activities to 
comply with legal requirements may result in the superficial acceptance of underlying ; 
concepts. The mandate may not allow sufficient opportunity to test and develo(y : activities j 
.on site. ** . * *v ; 

As it relates to the client. Clients tfiay perceive that their freedom to reject the innovation has 
been diminished. Therefore, they may resist use of the product, v 1 



As it relates tp the advocate, it is very difficult to ensure acceptance of vocational education 
through legal mandates. Usually, the advocate cannot sufficiently supervise educators to 
determine if appropriate materials and procedures^are being used in educational activities. 



27, FAIT ACCOMPLI 



The decision to use a product, and consequently make changes without consulting users in 
advance, is the meaning of this technique. 




DISCUSSION 



ADVANTAGES* 



A "fait accompli" implies the need to overcome 
time delays and any potential resistance by assuring 
the implementation of a product. This may 'be effec- 
tive in the short run; however, it tends to generate 
feelings of helplessness and contributes to a poor self- 
Image among clients. The implementation of a product 
in this jrianner raises questions about its. survival when* 
ever supervisor are not present to observe staff be- 
havior. It is an authoritarian technique which has 
limited application in the school system. 



As it relates to the product. This technique promotes immediate use of the product. 



As it relates to the client. Clients are immediately aware of their obligations and involvement^ 
In vocational education. ' ^ 



As it relates to the advocate. If the technique is successful; it reduces or eliminates the need 
for advoca££. The time required for collective decision-making is reduced. ^ 



THE TECHNIQUE IN ACTION 

Sometimes, superintendents of school districts 
and other administrators make commitments to out- 
side agencies which involve school principals and 
teachers without informing them in advance. 



DISADVANTAGES 



As it relates to the product. The product may not recei\& due consideration by gsers if they 
are left but of the decision to accept it. * 



As it relates to the client. Clients may reject a product if they perceive it to be forced* 
upon them. This may result in sabotage or other indications of resistant Behavior. 



/ 



As it relates to the advocate. This technique may create resistance which can lead to confron- 
tation between teachers and administrators. The advocate is placed in a mediating role which; 
is untenable, because he or she ha? no authority to allow changes in product implementation 
practices/ ^ s < 



28. STRATEGIC REPLACEMENT OF STAFF 



Strategic replacement is the substitution^ staff members in a key position to improve project 
effectiveness. 




DISCUSSION 

The dismissal pr transfer of $taff to other build- 
ings sometimes allows a vocational education project 
director to make up for lost timeln an installation 
activity. This technique assumes the advocate has the 
authority to reassign or otherwise remove staff from 
their present position. Therefore, it is difficult for 
the subordinate to use this technique for persons who 
are supervising their work. The replacement of staff 
has serious and major consequences on the installation 
progress of innovations. It should be seldom used and 
then only with discretion. When project staff are 
changed, a new influence network among clients must 
be established. This may result in time delays and 
other disadvantages to- the systematic use of vocational 
education products. 



THE TECHNIQUE IN ACTION 

* 

If a vocational education building coordinator 
has not been effective in gaining the cdnfidence of 
'the teachers and others who should use products, then 
he or she should be replaced. The, vocational education 
director should check with the building-principal and 
others in advance of the decision concerning who 
would be affectedly the replacement. 



. ADVANTAGES 

m 

As it relates to the product When necessary; the replacement of staff facilitates the imple- 
mentation of the product in a client setting. Hopefully, the new sta# member is familiar with 
vocational education and can do a better-job of cofnmunicating its virtues to clients. 

As it relates to the client. The replacement staff member should be more knowledgeable about 
the client, thus potentially more effective than the previous individual. 

As it relates to the advocate. When it becomes necessary to replace a staff member,Jt should be 
done quickly to facilitate cooperation among project team rnembers. . 



DISADVANTAGES 

As it relates to the product. The replacement of a keyjstaff member may delay implementation 
procedures temporarily, thus product utilization may take, place slowly during this period of 
transition. , 



' As it relates to the client. The client must become acquainted with another person when staff 
members are replaced. This takes timel Old loyalties to the replaced person may become 
obstacles to future progress. 

As it relates to the advocate, the replacement of a key staff member usually causes disruption 
and inconvenience in the implemeniatiop program. The project director must judge thelong 
range benefits of replacing key staff tnembers when compared to the short run problems of 
. bringing new individuals into the project. " \. / 
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